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Preface to the Second Edition 


The first edition of this book appeared at the end of the last century and, 
since then, it has been used as a textbook in several graduate courses, sum- 
mer schools, and a preconference tutorial workshop on Nonlinear Systems. 
Thanks to the experience gained in these activities, several modifications ap- 
peared to be appropriate. The chapter on modeling was enlarged and it now 
includes results on standard realization of nonlinear systems. This is moti- 
vated by the importance of state-space representations in the analysis and 
synthesis of nonlinear control systems in the current literature. The focus of 
the book remained about structural properties that do not involve stability 
issues and, for this reason, those issues are only marginally considered. The 
chapter on systems structure has been enlarged by adding more material on 
system inversion and by adding motivational examples. A new chapter on out- 
put feedback has been included at the end of the book, in view of the major 
importance it has in practical applications. Various supporting practical ex- 
amples borrowed from robotics, mechanics, and other application areas have 
been added throughout the book. A few exercises complete the chapters. 

The introduction to the differential algebraic approach has been deleted 
because new monographs on this topic are available. 

Finally, solutions to the problems can be found on the following website: 
http://www.springer.com/1-84628-594-1 


Ancona, May 2006, Giuseppe Conte and Annamaria Perdon 
Nantes, May 2006, Claude H. Moog 


Preface to the First Edition 


The theory of nonlinear control systems owes a large part of its modern de- 
velopment and success to the systematic use of differential geometric meth- 
ods and tools. One of the first problems to be considered from the point of 
view of differential geometry was, at the beginning of the 1970s, that of an- 
alyzing the controllability of a nonlinear system. Early works on that topic 
([111, 154, 155, 9]) highlighted the power and the potentiality of the differen- 
tial geometric approach and motivated the interest of many researchers. 

During the 1980s, the possibilities offered by the use of differential geomet- 
ric techniques in the study of nonlinear control systems were largely exploited. 
One of the underlying leading ideas (see [75, 87]) was that of generalizing, to 
the greatest possible extent, the so-called geometric approach which had been 
first developed in the linear case (see [6, 160]). The research effort produced, 
in that period, many important results and it provided effective solutions 
to several control problems, such as disturbance decoupling problems, non- 
interacting control problems, and model matching problems. Excellent and 
comprehensive descriptions of the methodology and of the results achieved, 
together with meaningful examples of applications, can be found in [86] and 
in [126]. 

In the second half of the 1980s the limits of the differential geometric 
approach started to be explored and to become known. In particular, it became 
clear that problems such as system inversion or the synthesis of dynamic 
feedbacks could hardly be tackled with the already well-established differential 
geometric methods. 

In the same period, the introduction of differential algebraic methods in 
the study of nonlinear control systems ([49]) offered a way to circumvent a 
number of difficulties encountered up to that time. The use of differential 
algebraic concepts characterized, through the work of several authors, a novel 
approach, which has essentially an algebraic nature, and, at the same time, 
it provided additional tools for investigating old and new problems. Further 
results on problems pertaining to inversion, noninteracting control, realization 
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and reduction to canonical forms were obtained in the following years, and 
others were made achievable. 

'Today, the use of an algebraic point of view in nonlinear control problems 
has gained popularity and diffusion. This motivates the present book, whose 
aim is to give an account of the algebraic approach to nonlinear system the- 
ory and of its development in recent years. Together with a number of results 
which are scattered in the literature, the reader will find in it a self contained, 
comprehensive description of techniques and tools that can enrich his equip- 
ment as a control theorist and can provide a solution to otherwise not easily 
tractable control problems. 

One of the distinctive characteristics that makes the algebraic approach 
interesting and useful is its inherent simplicity. In comparison with the math- 
ematical background needed for profitably employing differential geometric 
methods, the knowledge required for using the tools described in this book is 
very limited. A significant example of this is offered by the way in which the 
notion of accessibility and the problem of linearization are dealt with. In both 
cases, a single tool, based on elementary differentiation of a function, namely, 
the notion of relative degree, gives the key for carrying on a deep analysis and 
for characterizing relevant dynamic properties. From a didactic point of view, 
simplicity renders the algebraic approach a practicable and valid choice in 
teaching engineering courses on nonlinear control. The book emphasizes this 
aspect and is usable as a teaching aid. In addition, simplicity facilitates the 
development of efficient algorithmic procedures that are relevant in solving 
concrete analysis and synthesis problems. 

Another positive quality of the algebraic approach is its wide applicability 
in the field of dynamic systems and control. Although only continuous-time 
systems are considered in the book, the tools and methods described apply 
successfully to a number of control problems concerning discrete-time non- 
linear systems, as shown in [4, 68]. Applications to time-varying systems are 
also possible, and recent results have been obtained in dealing with time-delay 
systems (see [13, 120]). With respect to other general methodologies, then, the 
algebraic approach appears to be more versatile and capable of going to the 
heart of the problem. 

Only a basic knowledge of systems and control theory is required for read- 
ing the book, whose material is arranged in a self-explicatory way. The general 
setting and the fundamental notions are described and illustrated in the first 
part, entitled Methodology. Mathematical preliminaries are presented includ- 
ing notations from exterior differentiation. The system analysis completes this 
part and deals with fundamental properties as accessibility and observability. 
The structure algorithm and a canonical decomposition of the system are 
given as well. 

In the second part, entitled Applications to Control Problems, the tools 
and techniques of the algebraic approach are employed for solving a number of 
basic control problems that are of practical interest in fields such as robotics 
and control of general mechanical systems, as well as in process control. The 
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solution of the feedback linearization problem is given in terms of the acces- 
sibility filtration {Hx} introduced in Chapter 3. The disturbance decoupling 
problem is solved using the subspace ¥ N VY, namely, the subspace that is 
observable independently from the input (Chapter 4). In the noninteracting 
control problem and in the model matching problem, we use the output fil- 
tration {Ex} and the structure algorithm (Chapter 5). 

Finally, in the third part, entitled Differential Algebra, differentially alge- 
braic tools and concepts are introduced in an elementary, but comprehensive, 
way, and the results of the first parts are revisited and analyzed from a dif- 
ferentially algebraic point of view. The notions described in the third part 
may contribute to expand not only the technical knowledge of the reader, 
but also his comprehension of the key ideas of the algebraic approach. A con- 
ceptually powerful way of approaching the theory of nonlinear systems has 
been proposed at the end of the 1980s in [49, 52, 54], introducing the use 
of differential algebra and differential-algebraic methods. In comparison with 
other approaches which employ differential geometric methods (see [86, 126) 
for a comprehensive description) or Volterra or generating series (see [48]), 
this one appears in particular capable of removing some drawbacks present in 
the notions of rank and it allows us to characterize general invertible compen- 
sators. In addition, it provides useful insight and results in connection with 
various analysis and synthesis problems (see [44, 52, 54, 64, 136]). Although 
differential algebraic methods are better suited for dealing with systems de- 
scribed by polynomials or rational functions, extensions to more general cases 
(as suggested, for instance, in [50, 141]) are possible. Here, we give a brief 
introduction to the principal notions of differential algebra and we introduce 
a general notion of dynamic systems in differential algebraic terms. Related 
system theoretical properties are described and the principal results obtained 
by the differential algebraic approach are mentioned without entering into the 
detailsto help the reader in establishing a connection with the notions studied 
in the previous parts of this book. 

The authors acknowledge the NATO for its financial support of a joint 
research project under grant CRG 890101. Several results of this project are 
reported in this book. 

Finally, the authors would like to thank J.W. Grizzle, and M.D. di 
Benedetto for some joint research work which inspired this book. Valuable 
discussions with M. Fliess, A. Isidori, A. Glumineau, E. Aranda, J.B. Pomet, 
R. Andiarti, U. Kotta, and Y.F. Zheng are acknowledged as well as the care- 
ful reading by L.A. Márquez Martínez and R. Pothin, and the help of E. Le 
Carpentier. 


Ancona, December 1998, Giuseppe Conte and Annamaria Perdon 
Nantes, December 1998, Claude H. Moog 
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Part I 


Methodology 


1 


Preliminaries 


In very general terms, a dynamic system is a mathematical object that models, 
in some way, the evolution over time of a given physical phenomenon. Many 
authors, in the recent history of system and control theory, have provided con- 
crete refinements and specializations of the above informal definition, from the 
axiomatic characterization given in [99], to the development of the so-called 
behavioral point of view [133, 159], or to the module theoretical characteriza- 
tion proposed in [54]. 

Here, we do not enter into this debate, but, assuming the classical control 
theoretical point of view, we view dynamic systems as objects described by a 
system of first-order differential equations of the form 


_ [t= f(z) + g(z)u 
X= 5 B (1.1) 


where the independent variable t € IR denotes time; the state x(-) belongs 
to IR^; the input u(-) belongs to IR™; the input y(-) belongs to IRP”; and the 
entries of f, g, h are functions in a sufficiently general class. 

Dynamic systems of the above kind arise naturally in modeling, at least locally, 
many physical phenomena by first principles. Moreover, techniques based on 
these models have proved quite effective in analyzing and controlling objects 
such as machines, robots, vehicles as well as industrial, economic, and biologi- 
cal processes [101, 147]. These considerations respond to two primary concerns 
about the choice of our models, namely, generality and usefulness. However, 
to make the picture more precise, it remains to specify in which class of func- 
tions f, g, and h are taken. The following discussion will help us to make a 
motivated choice. 

Modeling involves approximation and some degree of uncertainty in dealing 
with dynamic systems, we are naturally interested in properties whose validity 
in nominal situations may imply validity in almost all situations, that is, in 
almost all situations except, so to say, in pathological ones. A way to capture 
this feature in mathematical terms is that of considering generic properties, 
that is, properties that hold on open and dense subsets of suitable domains of 
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definition, provided they hold at some point of such domains. This, however, 
imposes some restriction on the class of mathematical objects we want to deal 
with because the concept of generic properties must make sense for them. 
To understand this fact and its consequences better, let us consider, for in- 
stance, the role of the vector field g(x) in (1.1). Using a model of the form 
(1.1), we may clearly ask that independent inputs have, in general, indepen- 
dent effects on the system. Otherwise, simpler models, in which the dimension 
of the input vector u is reduced, could be used, at least locally. Since this fact 
depends on the rank of the vector field g(x) at different points x of the space 
of states, it is useful to require that the property of having maximal rank 
is generic for g(x). In particular, this implies that vector fields g(x) whose 
components are C^? functions are not admissible in (1.1), since there are C^? 
2 
functions, e.g., f(a) = T M Hrs that, being neither generically zero 
i i 0, ifr > 0’ , 

nor generically different from zero, could give rise to vector fields whose rank 
is neither generically maximal nor generically lower than the maximum. In 
other terms, the notion of generic property does not make sense, in general, 
for systems defined by C% functions. The situation is different if we restrict 
our attention to systems defined by analytic functions, and also meromorphic 
ones, and this, as stated in Section 1.2, motivates our choice throughout the 
book. 


1.1 Analytic and Meromorphic Functions 


To specify the class of functions we will deal with in our models, let us intro- 
duce the following definition. 





10% 





exp (-1/(10x2)) 























Fig. 1.1. Graph of exp(—1/102?) 


Definition 1.1. Let I C IR be an open interval. A function f : I — R 
is analytic at a point xo € I if it admits a Taylor series expansion in a 
neighborhood of xo. If f is analytic at every point of I C IR, we say that f is 
analytic in I. 


1.1 Analytic and Meromorphic Functions 5 


Examples of analytic functions are given by polynomial functions, as well 
as by the trigonometric functions sin z and cos x. Rational functions are ana- 
lytic at any point in their domain of definition. 


—1/z? ; 
The function f(x) — { i ! xd a i is C??, but it is not analytic at x = 0 
; ifs = 
(see Figure 1.1). 
The basic property of analytic functions we are interested in is stated in 


the following proposition. 


Proposition 1.2. Let I C IR be an open interval, and let f : I — IR be an 
analytic function on I; then either 

(i) f =0 in I, or 

(ti) the zeros of f in I are isolated. 


Proof. Let Z(f) denote the set of zeros of f in I. Since f is analytic in 
I, for every point x € Z(f), there exists a neighborhood D(z,r) = {x € 
R such that | x — z |< r} C I such that 


oo 
f(z) =>) e(z- 2)" 
n=0 
for x € D(z,r). Now, two cases are possible: either cn = 0 for n = 0,1,2,..., 
or there exists a minimal positive integer m such that c4, Z 0 and cn = 0 for 
n « m. In the latter case, we can write 


f(x) = (x — z)” fi(z) (1.2) 

where dd 
fila) = V enen(z — 2)” andfi(z) £0 (1.3) 

n=0 


By continuity, fi(x) Æ 0 in a neighborhood D(z,ri) and also f(x) 4 0 for 
x # in D(z,ri), then Z is an isolated zero. Alternatively, in the first case, 
f = 0 in D(z,r) and, hence, i is an interior point of Z(f). Then, Z(f) 
consists of points that are either isolated or interior. In particular, assume 
that there exists at least one point z in Z(f) which is interior and let A be 
the connected component of Z(f) that contains z. If the point sup{ A} belongs 
to I, by continuity of f, it belongs to Z(f) and hence, since it is not isolated 
but, necessarily, interior, it must coincide with sup{I}. Coincidence obviously 
holds also if sup{A} does not belong to I. Then, we get sup{A} = sup{I} 
and, in the same way, inf ( A) = inf (I). Therefore, Z(f) = I and f = 0 in 
I. E 


A polynomial function has a finite number of zeros which are isolated. 
The function f(x) = sing has an infinite number of isolated zeros located 
at x = kr for any positive or negative integer k. A typical example of a 
nonanalytic continuous function whose zeros are not isolated is the following. 
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Example 1.3. The function f(x), defined by 


| [sin(1/z), ifz 40 
as ifz =0 


is not analytic since x = 0 is a point of accumulation for the zeros of f (see 
Figure 1.3). 
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Fig. 1.2. Graph of sin(1/x) 


Example 1.4. The function f(x), defined by 


f eV sin(1/z), ifx z 0 
fe) - [6 ifz — 0 


is not analytic since x = 0 is a point of accumulation for the zeros of f. 
However, it is a C™ function. 


In the multivariable case, one can analogously consider an open domain D C 
IR", n € IN and the following Definition. 


Definition 1.5. A function f : D — IR is said analytic in D if it coincides 
with its Taylor expansion in the neighborhood of every point xo € D. 


'The generalization of Proposition 1.2 becomes 


Proposition 1.6. Let D C IR be a convex, open domain and let f : D — IR 
be an analytic function on D, then either 


(i) f =0 on D, or 
(ti) the set of zeros of f in D has an empty interior. 


Proof. Given any point x; € D, take a point xo, if any exists, in the interior 
of the set of zeros of f in D. The straight line L that passes through zı and 
zo contains an interval whose points are zeros of f and, henceforth, of the 
restriction of f to L. Since the restriction of f to L is analytic, it is zero by 
Proposition 1.2, and hence f (2) = 0. | 
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Example 1.7. Let f : IR? — IR, be defined by f(x1, £2) = zı — 1. It is easily 
seen that f is analytic. For any point P € IR? which belongs to the set Z 
of zeros of f, there does not exist any IR?-neighborhood included in Z (see 
Figure 1.7). 


T2 


set Z of zeros of f 





Fig. 1.3. Zeros of f (x1, £2) = xı — 1 


By Proposition 1.6, nonzero analytic functions defined on JR” are different 
from 0 at the points of an open (since the set of zeros is obviously closed) and 
dense subset of JR”, or, in other terms, they are generically different from 0. 
Then, it makes sense to define the generic rank of a matrix whose entries are 
analytic functions as the dimension of the maximum square submatrix hav- 
ing a nonzero determinant. As the determinant is an analytic function, the 
generic rank coincides with the rank of the matrix at the points of an open, 
dense subset of IR”. Moreover, the generic rank is greater than or equal to the 
rank at any point of JR”. Recalling what we said about the rank of the vector 
field g(x) appearing in (1.1) and our interest in it being generically maximal, 
it should be clear, now, that we are motivated to assume that the functions 
f, g, and h in (1.1) are analytic. 

If a function f(x) is analytic, in general, the same is not true for its multi- 
plicative inverse 1/ f(x). However, in a suitable algebraic framework, we can 
give a notion of the multiplicative inverse of a nonzero analytic function. To 
explain this, let us first note that, with the usual notions of sum, denoted by 
+, and of product, denoted by -, the set of analytic functions from JR" to IR 
forms a ring, denoted by A,. An important ring theoretical property of A, is 
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that it does not contain zero divisors.! 
Note that C° functions too form a ring, but in that ring there are zero divi- 
sors, for instance, the nonzero elements 


E ee ifz «0 
Ate) = (t ifz >0 


= 0 ifr <0 
? We so 

fa(x) = lue. ifs 0 
whose product is identically zero. Rings that do not have zero divisors are 
called integral domains and possess several nice properties (see, e.g., [5] for 
classification of rings and for generalities about the following construction). 
Here, we are interested in the fact that an integral domain can be naturally 
embedded in a larger algebraic object, called its quotient field, to provide a 
notion of multiplicative inverse to every nonzero element. The construction 
of the quotient field of A,, called K,, is quite general. The elements of K, 
are pairs (f, g) of elements of A, such that g 4 0, modulo the equivalence 
relation z&g defined by (f,g) n (f’,g’) if and only if fg’ = gf’. Choosing 
a representative in the equivalence class, an element of K, will be written as 
f/g. Using representatives, the sum and product, still denoted by + and ., of 
two elements f/f» and g1/g» of K, can be defined as follows: 


(fis gi) + (fa, 92) := (a: 92 + f2: 91,91 ` 92) 


(fi, g1) : (fo, 92) :9 (fi > f2, 91 ` 92) 


Note that the above definitions are well posed in K,, since gı - g2 Æ 0 and the 
result of the sum and product does not depend on the chosen representatives. 
With the above operation, X, is a field. The ring A, can be identified with 
a subring of K, mapping any element f € A, to f/1 € Kr. Given f € Ar, 
f x 0, its inverse in f € K, is 1/f. In the following, we will write f for the 
element f/1 and fg for the product f -g in Kr. 

The elements of the quotient field K, of the ring of analytic functions are 
called meromorphic functions . 

Any rational function is a meromorphic function; another typical example is 
tanz = sinz/cosz. If we look to meromorphic functions as functions of a 
real n-dimensional variable, we see that their domains of definition are open 
and dense subsets of IR". At the same time, their sets of zeros have empty 
interiors. 


1.2 Control Systems 


As mentioned in Section 1, we can now state precisely that the class of dynamic 
systems we are going to deal with basically consists of objects defined by a 


1 In a ring A, a nonzero element x is a zero divisor if there exists some other nonzero 
element y such that x -y = 0. 
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set of first-order differential equations of the form 


__ fèt) = FH) + gH ult) 
ve d = h(a(t)) ug 


where the independent variable t € IR denotes time; the state x(-) € IR”; 
the input u(-) € IR"; the output y(-) € IRP”; and the entries of f, g, h are 
meromorphic functions. 

In addition, we ask that the following assumption is satisfied. 


Assumption 1.8 Given a system X of the form (1.4), the matrix g(x) is 
such that rank g= m. 


Dynamic systems of the above kind are usually called control systems or 

nonlinear control systems if one wants to stress the fact that f and h are 
generally nonlinear and g is not constant. As no confusion is possible, we will 
usually drop the variable t from equations (1.4) and others of the same kind. 
We will refer to the representation (1.4) as the state-space representation or 
internal representation of a control system. External representations, on which 
the state variable does not appear, will be discussed in Chapter 2, together 
with their relation to internal representations. 
A remarkable property of the system of differential equations (1.4) is that it 
is affine in the input variable u. In principle, this is a nontrivial restriction of 
the class of dynamic systems we want to consider, since more general models 
could be obtained by substituting (1.4) with 


| f= f(z,u) 
X= fae (1.5) 


where the variables x € IR”, u € IR™, and y € IR? have the usual meaning and 
the entries of f,g, and h are meromorphic functions. However, affine control 
systems, that is dynamic systems defined by (1.4), are sufficiently general for 
modelling purposes. 

In addition, the class of nonlinear systems affine in the control is closed 
with respect to basic system theoretical operations, such as series and par- 
allel composition, and, what is crucial, state feedback of the form u(t) — 
a(a(t)) + B(x(t))v(t) where the entries of a(x) and B(x) are meromorphic 
functions. This is not true for systems defined by equations of the form (1.5) 
because, for instance, for f(r,u) = sin u, the choice of a feedback u = 1/x 
would give rise to a representation whose elements are not meromorphic func- 
tions. 

Although in some situations we will need to consider dynamic systems of a 
more general kind and more exotic feedbacks than those described above, we 
will in general deal with objects that have an affine representation in u. 
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1.3 Linear Algebraic Setting 


Assuming that a nonlinear control system X of the form (1.1) is given, the 
objective of this section is to construct an algebraic setting for defining and 
studying the system theoretical properties of X. Our approach is built up 
by introducing the notion of differential form in an abstract and formal way. 
This choice is motivated by simplicity and by the fact that in the rest of the 
book we will be interested only in the abstract algebraic and formal properties 
of differential forms. Other less abstract treatments of the same topics, like 
those developed in [83, 101, 126, 157] agree at a formal level with the one 
described here. Our approach has contact points with that of [19] and, to 
avoid technicalities, the reader is referred to [19] for proofs and technical 
constructions not found here. 

To begin with, denoting by n and m, respectively, the dimensions of the 
state space and of the input space of the system X, let us consider the infinite 
set of real indeterminates 

C= {x; i= Lenonu, j — 1,...,m,k > 0} 
For any positive integer r, we use the first r elements of C to denote the 
coordinates of a point in IR”. Hence, a function from IR" to IR, in particular 
an element of Kr, will be written as a function in the first r indeterminates 
of C. 

The usual partial derivative operators O/Ox; and 0/ du” act naturally 
on the field X, of all meromorphic functions from JR" to JR, which, for that 
reason, is said to be endowed with a differential field structure. Differential 
fields and their properties will not be explicitly employed as tools in this 
book. However, the reader can find a brief introduction to them, together 
with an essential description of the point of view one can develop on control 
theory starting from differential algebra, in [26], as well as in the third part 
of [23]. More information can be found in [98, 102, 140]. Here, it is sufficient 
for our aims to remark that, letting K denote the set theoretical union U,. Kr, 
K has an obvious field structure, and, moreover, it can be endowed with a 
differential structure determined by the system X. Because any element of K 
is a meromorphic function depending on a finite subset of indeterminates of C 
and, consequently, can be in general denoted by F({2;, ut? y, we can define 
a derivative operator 6, acting on K, as follows : 


Öxi = fi(x) + gi(x)u for all i=1,...,n 


dul") = ut?) fork 20 and forall j=1,...,m 


dF ({ai,u}) = M (0F/Ovi)óvi - Y, — (OFJ/Ouf? out? 


i=l j=1,...,m;k>0 
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'The resulting differential field is the starting point for a number of con- 
structions that will be used in characterizing the system theoretical properties 
of X. 


1.3.1 One-forms 


We consider now the infinite set of symbols 


dc = (dz;,i = 1,... n; duf? j =1,...,m,k > 0) (1.6) 


and we denote by £ the vector space spanned over K by the elements of dC, 
namely 
E = spanydC. (1.7) 


Any element in £ is a vector of the form 


i=1 j 


where only a finite number of coefficients Fj, are nonzero elements of K. We 
can define now an operator from K to E, which by abuse of notation will be 
denoted by d, in the following way: 


n 


dF((z;,u(?]) = V (8F/0z)dri- — M, — (9F/OufP au? 


i=l g2 5s m;k>0 


The elements of € will be called one-forms and we will say that v € € is an 
exact one-form, or that it is integrable, if v = dF for some F € K. We will 
usually refer to dF as to the differential of F. 


Example 1.9. Let F = sin(x1z2) € K. Then, 
dF = cos(x1 22) [xoda4 + x1dx2] € € 


The vector space of one-forms € can be endowed with a differential struc- 
ture by defining a derivative operator A, in terms of the derivative operator 
6 and of the differential operator d acting on K, as follows: 

k 
Av = Ay iar Fidzi + 35,5. ko Fixed ’) 


= Xia (Fide; + Fid(ózi)) + Dojo, nik >o (9 Ej du(? P Fjęd(õu™)) 


Sue 


1.3.2 Two-forms 
We consider now the infinite set of symbols 


^dC — (dz; ^ dzy; du? Adult); dz; Adu); dul) ^dzj, fori=1,...,n 
i —L.oq4mj21,omig —LeogmikcoLnk > 0} 
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and the vector space, that we denote by AE, spanned over K by the elements of 
AdC. In ^£, we consider the equivalence relation R spanned by the equalities 


da ^ d8 = —dfi ^ da (1.8) 


Note that the above relation implies that dz; ^ dz; = 0 for every à and 
duc? ^ duc? = 0 for every j and k. 

The vector space AE mod R will be denoted in the following by €°). The 
elements of €°) are called two-forms. 

We can define now an operator from € to £2, that by abuse of notation will 


again be denoted by d, in the following way : 


dv—-d(M Eds — M. — Pad?) 
i—1 


j=l,...,m 
k>0 
= — M (6F/day)dey Adi + M, (5Fi/oulP du ^ d; 
121,4... i—]1,...,n 
i —1,...,n 2 Esso fh 
k>0 
QE m 
jT 
k>0 
k k k 
+ SOF. /óu(? au? ^ du) mod R 
j=l,...,m 
j' =1,...,m 
k>0 


A canonical representative of dv is given by 


dv = X (6F;/ðxv — óFy /Sxi)dzy Adz; 
iid! 
s 2. (ÖF; /óu(? = dF jx /5a;)du\” ^ dx; 
4—1,...,m;j—1,...,m;k20 ; 
+ M)  GFajóuy) —6Fy [ouf duy ) ^ dus? 
j2j'k20;k'20 





Example 1.10. Let v = da, — (z1/z2)dz5, then 


dv = 0 — (1/z2)dzi ^ dz» 
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1.3.3 s-forms 


We need now to consider a more general construction of the same kind as that 
giving rise to €). To this aim, let us consider, for any integer s, the infinite 
set of symbols 


ASAC = {déo A d£ A... A d£; & €C;i=0,..., 8} 


and the vector space that we denote by A°€ spanned over K by the elements of 
A*dC. In AFE, we consider the equivalence relation R spanned by the equalities 


déi ^ d£, A... ^ déi = (-1)7 déj ^ d£j, ^ ... ^ d£j, 


where c is the signature of the permutation b i. 
ASE mod R will be denoted in the following by £ 5^, its elements are called 
(s + 1)-forms. 

Note that the above relation implies that déi, Ad&;, ^. ..Ad£;i, = 0 if déi, = déi, 
for some index j and k. 

By the constructions described above, we obtain a set of vector spaces E, 
€),..., EC) that are related to the system X. These algebraic objects will 
be the basic tools for analyzing the system properties of X in Chapters 3 to 
6 and for solving several design problems in the second part of the book. 


}. The vector space 


1.3.4 Exterior Product 
The exterior product or wedge product of a p-form w: and a q-form w2, denoted 


by wi A w2, can now be defined as the (p + q)-form whose representative, if w1 
is represented as 


with &(9 € A«-!dC, is given by 


Q1 ^ W2 = 5 FG,” ^ p 


It can easily be verified that the exterior product is associative. Moreover, it 
induces a map A : EP) x £(9 — €+% given, quite obviously, by A(w1, w2) = 
WwW, ^ w2. 
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1.4 Frobenius Theorem 


In this section, we investigate the problem of checking the exactness of a given 
one-form v € €, namely, if v = dy for some q € K. To begin with, let us first 
state some elementary facts. 


Definition 1.11. A one-form v € E is closed if dv = 0. 
Proposition 1.12. Any exact one-form is closed. 


Proof. Consider a function y € K of n variables, say £1,---,& with £; € C. 
Then, dy = x=” adt; and 


2 
dd) = Diy se de; dt; ^ dé 
9? 9? 
= Vey oe = x d£; ^ dé; 


=0 
E 


Poincaré’s Lemma (see [19] for a proof) establishes that the converse of Propo- 
sition 1.12 is true only locally. 


Lemma 1.13. Poincaré’s Lemma Let v be a closed one-form in E. Then, 
there exists p € K such that locally v = dy. 


Example 1.14. A typical example of a closed form that is not exact is the fol- 


lowing. In IR?, consider the closed one-form w = —“2—,dx, —— 21 dx5. Lo- 
nrg dal Eee E Bagh tg 


2 
cally, around any point (#1, £2) such that x» Z 0, w = d [arctan(z1/22)], and 
around any point (x1, £2) such that x2 = 0 and zı Z 0, w = d [arctan(—22/24)]. 
But there is no function y such that w = dy globally. 


A requirement weaker than exactness for a one-form v is that of being 
colinear to an exact form, i.e. there exist À and y in K such that Av = dy or, 
equivalently, that span (v) = span, (dq). A function A such that Av = dy is 
called an integrating factor. The characterization of this property is a special 
case of the Frobenius Theorem that will be stated later. 


Theorem 1.15. Given v € E, there exists a function q such that span (v) = 
spany(dq] if and only if 
dv^v-—0 


Proof. Necessity: Since dp € spang {v}, there exists a nonzero function o such 
that av = dy. Hence, av is exact, that is, d(av) = 0. From 


0 = d(av) = da ^ v + adv 
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it follows 
0=d(av)Av =0+advAv 


which yields the desired result. 
Sufficiency: The proof of sufficiency is not elementary and for that the reader 
is referred to [19, 46]. | 


To generalize the result of Theorem 1.15, let us introduce the following defi- 
nition. 


Definition 1.16. A subspace V C € is closed, or integrable, if V has a basis 
which consists only of closed forms. 


Theorem 1.17. Frobenius Theorem Let V = spanyc(wi,...,wr) be a sub- 
space of £. V is closed if and only if 


dw; ^w A... Awr = 0, for anyi = 1,...,r 


Example 1.18. 


e The one-form w = zıdzı + zədzə2 is closed according to Definition 1.11. 
In fact, w = d(x? + 22). 

e The one-form w = dx, + z1dx2 is not closed since dw = dx, ^ dz2 Æ 0. 
However, the vector space span¢{w} is integrable since dw ^ w = 0 and 
one may choose the integrating factor a = 1/21. 


The version of the Frobenius Theorem stated above is dual of the version 
commonly presented in the literature. The reason for this choice is that it 
fits more naturally with our formalism. The reader can find a proof of the 
Theorem in [19], or also, in dual terms, in [46, 118]. 

'The necessary and sufficient condition of the Frobenius Theorem is verified, 
in particular, if V has dimension n — 1 and its generators depend on n inde- 
terminates. Let us state and prove explicitly that this results. 


Proposition 1.19. Let V = spanyc(wi,..., 05-1) be a (n — 1)-dimensional 

subspace of E and assume that its generators wi, for i = 1,...,m — 1, depend 

on n indeterminates, say z1,..., £n. Then, V is closed (integrable). 

Proof. Denote by X(x), where x = (z1, ...,24)7 , the annihilator of V, so that 
wi(x)-X (x) =0 


for any à = 1,...,n — 1. Without loss of generality, assume that 
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and consider the differential equation 


with initial condition z(0) = xo. The solution PŽ (xo) of such an equation can 


be written in the form 
t + Z10 


o»(t, zo) 
PX (zo) = : 
nlt, zo) 
The variable t can be formally eliminated using the equality t = x; — £10, so 
that 
Xi = Qilzı = £10, £0) 


for i = 2,...,n. Defining 


pi(z) T1 
pa(x) 72826 Q2(x1 — £19, t9) 
pa (x) Tin T dnl — 110; Xo) 





one easily checks that p; = 0 or, equivalently, that dp;(z) L X(x) for i= 





2, ..., n. Since rank 22) =n, p(x) defines a change of coordinates and V = 
xv 
span {dp2,...,dpn}. | 


1.5 Examples 


The algebraic formalism of one-forms is devised mainly for facilitating com- 
putations involving gradients and Jacobian matrices. 
Note, in particular, that the differential dy of the output of the control 
system (1.1) is a vector in £: 
Oh Oh 


dy = —d eee eee a 
y Ox Wu Tu et 


The differential of the kth time derivative of y is in € as well. 


Example 1.20. The one-form wı = dx; € € may be thought of, with respect 
to the basis dC, as the row vector [1 00-- -| . This row vector is the Jacobian 
[3L oe e of the function f(x) = 21, which belongs to K, and it is 
obviously exact. 
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Example 1.21. Let us consider the one-form w2 = xadx; € €, which may be 
identified with the row vector wz = [73 0 0 ---]. The exactness or integrability 
of wə is equivalent to the existence of a function wy» € E, such that wz = 


E a oe --- |. If such a v does exist, then necessarily it solves the 
system 

Oy _ 

0x3 — 


Using second-order derivatives, one concludes that there is no solution since 


9 0 4, 0 Wy _ 


0x3 Ox, n Ox, Óx3 B 


Examples of this kind motivate a formal study of second-order derivatives 
and give rise to the notion of two-forms, that generalize somehow Hessian 
matrices, consisting of second-order partial derivatives. 


Example 1.22. Let v = (1/z2)dzi — (z1/zi)dxa. To check the closure (or 


local exactness) of v, one may proceed as above and compute X and 


9. ( —"1 |. The two-form dv embodies th ions: 
"I (=) e two-form dv embodies these computations: 


ð 1 0 — ťi 
dv = — | — | dr2 ^d — | — | dzi ^d 1.9 
E Ox (=) e zı + xı ( x2 ) s ii ( ) 
= —(1/z2)dza ^ da — (1/z2)dz4 ^ da» (1.10) 
Now, the closure of v results from the fact that ac = oo. or, since in 
2 


EC), dz, ^ dz = —dza ^ dz}, then dv = 0. In fact, v = d(a1/x2). 
In the case of Example 1.20 and of Example 1.21, respectively, 


dw = d(dzi) =0 


dwz = d(zadzi) = dza ^ dai + x3d(d21) = dra ^ dx, 


where dw» # 0 displays the fact that w2 is not exact. In fact, as a linear 
combination of the symbols da; A dz3 and dx3 A dx 1, dws reads as 


dw = 0 dx, ^ dza34- 1 dx3 ^ dai 
l l 
candidate for candidate for 
Q Ov Ə Ov 
Ox 0x; 0x3 Ox 


Since ae ge = eee for any w and dz, ^ dx3 = —dza ^ dz, dv» Æ 0 
formalizes the fact that there is no function v € K such that wz = dw. 
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Problems 


1.1. Prove that invertibility is a generic property for real square matrices. 


1.2. Prove that square, symmetric, real matrices are not generically positive 
definite. 


1.3. The dynamic system X defined by (1.1) is linear if the vector field g(x) 
is constant, namely, g(a) = B for a suitable matrix B, and the functions f (x) 
and h(x) are linear, namely f(x) = Ax and h(x) = Cx for suitable matrices A 
and C. For a linear system 2, controllability, namely, the possibility to drive 
the state to zero in finite time by applying a suitable input u(t), is equivalent 
to the condition 

rank|BABA? B...A" ! B] 2n 


n being the dimension of A. Prove that controllability is a generic property 
of linear systems. 


e- a. ifr <0 


0, ifx > 0 is not analytic at x = 0. 


1.4. Prove that the function f(x) = { 


1.5. Integration of one-forms 

Check if the following one-forms are exact and in case of a positive answer, 
find a function F whose differential coincides with them. 

(a) (1+ cos(x + y))dx + cos(x + y)dy 

x + 2y 1 











(b) mm dx + -zdy 
T y 
dx 4 d 
(c) x? + y? r? + y? y 
(d) — g £+ dy 
x? + y? 2 + 2 
(e) T A 
x? + y? + 2? x2 + 24 72 y r? + y? + 2? 
y+z x x 
f d 
0 "G-y- ea * ay 


1.6. Check if the one-form w = (—a?cos(y))dx + (xsin(y))dy is closed. If w 
is not a closed one-form, check if an integrating factor exists and in case of a 
positive answer, compute it. 


1.7. Exterior differentiation 
Compute the differential of the following differential forms: 
(a) sin(x + y)dx + (a? + 2y)dy + zdz 


Ib) toske hda 
v A dy 
( 





?)d 
d) (e?)dz N dy + x dy A dz 
e) dz A dy A dz 
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1.8. Prove that déis ^ d&i, A... \d&, = 0 if d£; = déi, for some index j and 
k. 


1.9. Exterior product 

Compute the exterior product between k-forms. 
(a) dx A(sin(y)dy A(x dx + (y?)dy) 

(b) (cos(ay)dx + (y*)dy) A(z dx + y dz) 

(c) (2a dx + (x + y)?dy + (1 — z)dz) A(ydx — zdz) 
(d) (e*)dz A dy + x dy A dz 

(e) (dz A dy) A (cos(x + y)dy A dz) 


2 
Modeling 


Dynamic systems may be described in several ways. Physics often yields de- 
scriptions in terms of high order differential equations that involve input and 
output variables. Starting from this situation, a typical control theoretical 
problem is that of restating such input-output descriptions in terms of cou- 
pled, first-order differential equations, introducing new instrumental internal 
variables or states. For linear systems, it is possible to switch easily from input- 
output, or external, representation to state-space, or internal, representation, 
using the Laplace transform to change the domain of the representation. Al- 
though such a tool for symbolic computation is not available for nonlinear 
systems, we show, in this chapter, that internal, state-space representation 
can be derived from input-output descriptions (their construction will be de- 
scribed as the realization problem) and conversely, external, input-output de- 
scriptions can be derived from state-space descriptions (their construction will 
be described as the state elimination problem) in a nonlinear context, too. 
To develop the tools required for dealing with this kind of problem, we will 
start by considering first the state elimination problem and, then, we will 
tackle the more relevant problem of constructing state-space representations 
from input/output relations. 


2.1 State Elimination 


Given the internal, or state-space, description of a system X, it is possible, in 
a sense to be made precise, to construct a representation of the relationship 
between input and output that it defines in a form that does not involve 
state variables. Although the validity of such a representation is only local, 
it nevertheless turns out to be useful for understanding the system behavior 
and, more important, its construction helps in clarifying the inverse problem 
of defining state variables and state equations from an input/output relation. 
To describe the situation, we can consider, without additional difficulties, 
internal representations more general than (??), i.e., representations of the 
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form (s) 
T= F odisse um) 
P = h(z,u, MUSS % ,u?) eu 


where, as usual, x € IR”, u € IR", and y € IR”, and the entries of f and 
h, which depend also on a finite number of time derivatives of the input, are 
analytic functions. 

So, given a system X of the form (2.1), the problem is to find, if possible, a 
set of input-output differential equations of the form 


Fi(y, 9, ..., 99, u ù... u) 20 ? t=1,...,p (2.2) 


which admits as solution any pair (y(t),u(t)) such that (y(t), u(t), x(t)) is 
a solution, for some x(t), of (2.1). Such a set of differential equations, if any 
exists, will be called an external, or input-output, representation of the system 
X described by (2.1). 


Theorem 2.1. Given a system X of the form (2.1), where the entries of f 
and h are analytic functions, there exist an integer y and an open dense subset 
V of R"*™ such that, in the neighborhood of any point of V, there exists an 
input-output representation of the system of the form (2.2). 


Proof. The first step in constructing an input-output representation consists 
of applying a suitable change of coordinates. To this aim, let us denote by sı 
the minimum nonnegative integer such that 


Ds s EC. s coe ee AT) 
—————————— — rank—— ————— 
Ox Ox 


If Ohy/Ox = 0 we define sı = 0. Analogously for 1 < j < p, let us denote by 
s; the minimum integer such that 


rank 


Du cig oce rt OY 


rank Da 
Dimi shel”) 
= rank——— —— 
Ox 
If Ze T 
Bios dero) OD ss her D) 
rank—————————— — = rank ———————————— —— 
Ox Ox 


we define Sj = 0. Write K = S810 ...4 Sp- The vector 
S = (hies ASO, py... hi8 71) 


where h; does not appear if s; = 0, satisfies the following relation 


rank | = K, for almost every x 
z 
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It will be established in Chapter 4 that the case K < n corresponds to 
nonobservable systems. In this case, there exist analytic functions gi1(x),..., 
Qn—K(x) such that the matrix 


As, gie ,Jn-K) 


bn Ox 


has full rank n. Then the system of equations 











£j = hi(a,u,..., ub) 
Tsi =h Dg u,... , ul(ats1—1)) 
Že 41 = he(z,u,..., ub) 
(2.3) 
Pss = hU (x, u,... , u(ats2—1)) 
Žs1+s2+...+5p mE hr 7D (a, TI ME: ju Ser ap) 
dogs Toa ED csse) i=1,... de 


is of the form F,(x,%,u,...,u) =0,i=1,...,n with 
OF, ..-,; Fn)/O(a1,..-,;2n) =J 


To avoid the introduction of new notations, it is not restrictive to assume 
y >max{a+s;—1,i=1,...,p}. The determinant of J is an analytic function 
whose set of zeros has an empty interior, so there exists an open dense subset 
V of IR"*^"" such that det is different from zero at every point of V and 
the implicit function theorem applies. Therefore there exist n functions 


vi = oi(%,u,...,u) for 1 <i<n 
which define a local diffeomorphism ¢ parametrized by u,...,u(?: 
1 = (i) (2.4) 


By applying the change of coordinates induced by (2.4), the system (2.1) 
becomes 
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Ze, = AY? (o(g),u,..., u) 
Psi = 5,42 
$545, = hS?)((),u,...,u™) (2.5) 
Fett, = he? (o(@),u,-..,u) 
Dortet ti = gi(%),u,...,u) i—1,...,n— K 
yı = 2 
Y2 = £s,41 
Yp = Petites go) 
In the neighborhood of any point where det J # 0, also 
Oh? an Phe ORT ðh ont” 
n unum 2b mr rx M 
Ox PMK3557'7"7' On? On?’ On 
so that 
ane? Ox 
n ee tpe acier e lJ aR. 
=[c1 ... Cs, 4-45, 0... Oley = 0 J > Spt 8i 


where e; is the jth column of the identity 


nC? (oa), u,...,u\”) depend only on 24,.. 


Since the following identities hold, 











Y= Tis 
yı = 22,..., 
O = žir forr=0 ed 
Yi = Xiere lOorr —U,...,51 
Yj — Vsi4--sj il 
Yj = Lsit---+sj—1 +2) Bi 
(r) _ = 
Yj = Us, 4---+8j3-1+1+r forr = 0,. 


matrix. Therefore the functions 


+5 Usyt...48;° 


..,87 -1, 9 =2,...,p 


From (2.5), we get the input-output relations we were looking for: 
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ye? x h (oly, d, 2m ay, u, MIT ul) 
Yj =, LO GCG age ae ge) (2.6) 


yp? x he? (oly, edi ape 9 TA : Yp; a re yee ya. "TN ul) 
L| 


The input-output equations (2.6) are not uniquely defined since, for in- 
stance, if K is less than n, different choices of the functions g;(z, u,..., u?) 
produce a different system (2.3). 

Instead of (51,...,55], it is possible to use the observability indices as defined 
in Chapter 4 to derive an analogous input-output equation. 


2.2 Examples 


Example 2.2. For the system 


Ly = ©3Uy 
t2 = u1 
t3 = ug 
Yı = Tı 
Y2 = T2 


we have j1 = 2z3u1, j1 = U2U1 + z3ü4, and finally 

ta = uzu + (di/ui1)di 
The last equation holds at every point in which u4 Æ 0. For the second output, 
yo = uz immediately. 


The following example shows that for a more general nonlinear system, where 
d does not appear explicitly, such as 


F(a,a,u,...,u) (2.7) 
the method described above cannot be applied. 
Example 2.8. Consider the system 
(t-u)? =0 
y-c 
The implicit function theorem cannot be invoked to obtain x, since for every 
x and every u, Ó(i — u)?/Ox = 0. By the way, an input-output relation for 
this example is given by 
(yu)? =0 
or by 
(ù -u) = 


26 2 Modeling 


Results similar to those described above may be found in [156]. A state elim- 
ination method which yields global results is studied in [44]. 


2.3 Generalized Realization 


Let us consider now the problem of going from an external, input-output rep- 
resentation of a dynamic system to an internal, state-space representation, 
that, in a sense to be made precise, defines the same relation between inputs 
and outputs as the external representation. We are interested in what is called 
the realization problem. In general, as an outcome of the realization process, 
starting from an external representation, one would like to obtain internal, 
state-space representations of the form (1.4) or, at least, of the form (1.5). 
These will be termed classical realizations; more general representations, as 
those we will discuss in this section, will be termed generalized realization. 
To begin with, we first recall some results from [54], which follow quite nat- 
urally from elementary manipulation of input-output equations and which 
yield a generalized realization. In the next section, a necessary and sufficient 
condition is given for the existence of a classical realization in the single- 
input /single-output (SISO) case. 

Consider an input-output differential equation of the form 


Fly,...,y™,u,...,u) =0 (2.8) 


where u and y are, respectively, a scalar input and a scalar output, F is 
a meromorphic function of its arguments; and 3207 is generically nonzero. 
An internal representation of the system described by (2.8) can easily be 
constructed by introducing the new variable x = (x1,..., £k), defined by 


(21,..., 2k) = (y, ..., (7?) (2.9) 


'This yields the following set of implicit state equations 


Ly = T2 

(2.10) 
Tk—1 = Tk 
F(zi,..., £k, dy, u,...,u(9) =0 


'The assumption about 2207 and the implicit function theorem , now, allow 
us to write, at least locally, 


tı = T2 
koi = Lk (2.11) 
Lk = plx, u, ù... , u) 


y= 2X1 


2.3 Generalized Realization 27 


Equations (2.11) give a representation of the input-output relation described 
by (2.8) with internal variables. Compared with (1.4), the representation given 
by (2.11) can be said to be a generalized realization; the adjective “general- 
ized” accounts for the presence of derivatives of u. According to this, the 
variable z can be interpreted as a generalized state variable. In addition, note 
that the application of the implicit function theorem, beside being noncon- 
structive, does not guarantee that y is a meromorphic function. 


Example 2.4. Consider the input-output equation y? = y + u. The above pro- 
cedure yields the implicit state equations 


2 


i^—r-cu 


or, locally, one of the following explicit realizations, depending on whether 
y>Oory<0. 


p (2.12) 
eo (2.13) 


Note that the right-hand side of the state equations in the above representa- 
tions is not meromorphic at the origin. 


In general, the above procedure does not yield classical realizations of the form 
(1.4). Also linear input-output relations, in case transmission zeros are present, 
give rise, in this way, to generalized realizations. It can be said that, in general, 
the presence of derivatives of u is somehow related to the presence of zero 
dynamics (this concept will be made more precise in Section 5.6, see also [88]) 
However, as we will show in the next section, generalized realizations of the 
form (2.11) may be transformed under suitable hypotheses into a realization 
containing no derivatives of u. 


Example 2.5. Consider the linear input-output relation j = u+ à that cor- 
responds to the transfer function eH. having a zero in s — —1. Although 
the input-output relation is linear, the above procedure yields a generalized 


realization: 


Tj = T2 
t2 = —u— ù 
y= tı 


The notions of controllability /accessibility and of observability that one can 
use in characterizing the structure of internal representations are reported in 
Chapters 3 and 4. Without going into the details now, we mention that, with 
respect to those notions, realization (2.11) is in general observable, but not 
necessarily accessible . In this sense, it is not minimal. 
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2.4 Classical Realization 


Conditions for ensuring the existence of a classical realization of the form (1.4), 
in particular containing no derivatives of the input, are fully characterized in 
[33] (see also [28, 47, 56, 91, 92, 150, 151, 158]). There exist simple input- 
output relations which do not admit a classical realization. A typical example 
in this sense is given by the input-output relation jj = ù?. 

Here we introduce an elementary result that fully solves the problem for the 
input-output relations having the particular form 


Sey discs P od n (2.14) 


where x is a meromorphic function of its arguments and E OI is generically 
nonzero. The input-output relation (2.14) admits a realization if and only if the 
right-hand side of (4.17) has a special polynomial structure in the derivatives 
of u. To investigate this structure, consider the dynamic system X, whose 


input is u^*9 and whose state is (y, 9, ...,y- P) ,u,à,. .. , uf). 
y y 0 
yea] l fe 
: d y = p 0 (s+1) 
Z|” =] $|t*io* (2.15) 
Pee) NS 0 
u 0 1 


— fe + geut» 


Given system (2.14), define the field K of meromorphic functions in a finite 
number of variables y, u, and their time derivatives. Let € be the formal vector 
space € = span, {dy | e € K}. 


Define the following subspace of € 
Hı = span {dy, dy, ... ,dy 79, du,... du?) 


Obviously, any one-form in Hı has to be differentiated at least once to depend 
explicitly on dult”), Let Hg denote the subspace of € which consists of all 
one-forms that have to be differentiated at least twice to depend explicitly on 
du (5*9, From (2.15), one easily computes 


H2 = span (dy, dj, .. ., dy P, du, ..., du^) 
Hz is a subspace of Hı which is more generally computed as 


Hə = spanc(v € Hi |o E Hi} (2.16) 
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More generally, define H; as the subspace of € which consists of all one- 
forms that have to be differentiated at least 7 times to depend explicitly on 
dust), 

More precisely, the subspaces H; are defined by induction as follows for 
i> 2. 

Aaa = span {w EH; |w E€ Hi} 

These subspaces will be used extensively later in this book and especially 

in Chapter 3. 


2.5 Input-output Equivalence and Realizations 


To introduce the equivalence of input-output systems and to study their min- 
imal state-space realization, we will use systems Xe, as defined in (2.15). 
Consider H, = spanc{w € Hi | w) € Ht, Vk > 0} = 0. Each nonzero 
vector in H%, is said to be autonomous for system (2.14). 


2.5.1 Irreducible Input-output Systems 


In this section, we will formalize a reduction algorithm to obtain the notion 
of input-output equivalence and a definition of realization. 


Definition 2.6 (Irreducible input-output system). System (2.14) is said 
to be an irreducible input-output system if the associated system (2.15) sat- 
isfies 

Hoo -—0 


Example 2.7. The input-output system jj = yu? + yù is irreducible since 


y ,Ü 0 

aly] _ | yuwtyu O}.. 

|u| ù ud ON 
ù 0 1 


is such that Hə = 0. It is worth noting that the set of solutions (u(t), y(t)) 
of jj = yu is a subset of the set of solutions of jj = yu? + yù, but the systems 
are not "equivalent? according to the forthcoming Definition 2.13. 


Example 2.8. ij = à + (y — u)? is not irreducible since 


y y ; 0 
d | y ut+(y—u) 0]. 
dtlul] ü "t 0o]” 

ù 0 1 


is not irreducible since d(y — u) € Hæ and we will claim that y = u is an 
irreducible input-output system of jj = ù + (gy — u)?. 
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2.5.2 Reduced Differential Form 


We are interested in minimal realizations, i.e. of the lowest order. We intro- 
duce definitions of reduced differential form, reduced input-output system and 
irreducible differential form, etc. to reach that goal. 


Definition 2.9 (Reduced differential form). An exact form dd’ € Ha is 
said to be a reduced differential form of system (2.14) if 


(a)do 0 
(b) dd! € Hoo. 


Definition 2.10 (Reduced input-output system). Let dd’ be a reduced 
differential form, that produces the differential equation 


9 (y, VIN E sue D. y^, Wytt ul) =0 (2.17) 


such that 8d! /Oy*) + 0, ¢"/Au) £0, and 029! /Oy(K" = 0 with k' > 0, 
s! > 0. Equation (2.17) has a unique solution under the condition 09! /Oy*) + 
0 

y? = ui (y, uy TD u,e, ut) (2.18) 


Then (2.18) is called a reduced input-output system of system (2.14). 


Definition 2.11 (Irreducible differential form). If (2.18) is an irre- 
ducible input-output system in the sense of Definition 2.6, then d(y*) — q/) 
is said to be an irreducible differential form of (2.14). 


Example 2.12 (Example 2.8 cont’d). d(y—u) € Hæ and y = wis an irreducible 
system. Thus, ¢’ = y — u = 0 is an irreducible input-output system of y = 
ù + (y—u)?. 


It is not true that any input-output system has an irreducible input-output 
system. Consider " 
j= Z (2.19) 
u 
dd’ = d(y/u) is a reduced differential form of (2.19) according to Definition 
2.9. Thus, system (2.19) is not irreducible. Let ¢’ = y/u = 0, which is not an 
irreducible input-output system in the sense of the above Definition. Therefore, 
system (2.19) does not admit any irreducible input-output system. 

In the special case of linear time-invariant systems, the reduction procedure 
corresponds to a pole/zero cancellation in the transfer function. For nonlinear 
systems, the above procedure also generalizes the so-called primitive step in 
[28]. 
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2.5.3 Input-output Equivalence 


We restrict our attention to the family of input-output systems that admit an 
irreducible input-output system: see Definition 2.6. Therefore, it is possible to 
introduce an equivalence relation on the family. 

Definition 2.13 (Input-output equivalence). Two input-output systems 


are said to be input-output equivalent if they have the same irreducible input- 
output system representation 


y) => ply, MS pee Uys es, ul) (2.20) 


Example 2.14. The two systems 


j-à-2( - u)? 


and 
y O9 =ü 


do admit the same irreducible input-output system, y = u. 


2.5.4 Realizations 


A general definition of realization is given, that describes the relationships 
between state-space equations (1.1) and input-output equations (2.14). 

An algorithm realizing the state-space systems (1.1) from input-output 
systems (2.14) will be provided in Section 2.8.1, as well as a necessary and 
sufficient condition for the existence of such a realization. 


Definition 2.15 (Realization). A state-space system (1.1) is said to be a 
realization of the input-output system (2.14) if the elimination of the state 
variables in (1.1) yields an input-output equation described by 


y™ = oly, ve ,y ^79, u, "Tt. ul?) 
which is input-output equivalent to (2.14). 


The system (2.14) is said to be realizable if there exists a realization in 
the sense of Definition 2.15. 


2.6 A Necessary and Sufficient Condition for the 
Existence of a Realization 


We make use here of the subspaces introduced in (2.16), to derive a full char- 
acterization of the existence of a classical realization. 
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Theorem 2.16. There exists an observable state-space system 
i= f(r,u) 
: 2.21 
{pone d 
which is a realization for (2.14) if and only if 


e ks 
e and, Hi is integrable for each i = 1,...,s +2. 


Proof. Sufficiency: Let {d&,...,d&,} be a basis of Hs+2. From the construc- 
tion of the subspaces Hi, 


Hes+1 = H2 D span, {du} 
Hs = Hs+2 © span {du, dù} 





(2.22) 





Hı = Hs+2 ® span {du,... ,du(9) 
Introduce the following coordinate transformation for the system (2.15): 


zı = Gg. u9) 


Tkt1 =U 





Tk+s+1 = ul) 


From 71,42 C Hs41, it follows d£; = v» m ad + Bdu, for each j = 1,...,k. 
Let x = (z1,...,c4). Thus, at least locally, 


t= f(x,u) (2.24) 


The assumption k > s indicates that the output y depends only on zx. 
Necessity: Assume that the observable state-space system 


t-— f(z,u) 
y = h(a) 


is a realization for the input-output system (2.14). Since the state-space sys- 
tem is proper, necessarily k > s. 


Hı = spang (dz, du, ..., du? 


4,41 = span {dz, du} 
Hs+2 = spang {dx} 





From (2.23), the spaces H; are integrable as expected. | 
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Example 2.17. Let ij = à?, and compute 


Hı = span, (dy, dy, du, du} 
5 = span {dy, dy, du} 
H3 = span {dy, dy — 2üdu)) 


Since Hg is not integrable, there does not exist any state-space system gener- 
ating j = u?. This can be checked directly, or using some results in [33]. 


Example 2.18. Let jj = u?. The conditions of Theorem 2.16 are fulfilled and 
the state variables x; = y and x2 = y yield 


tı = T2 
ta = u? 
y= FT 


whose state elimination yields jj = u?. 


2.7 Minimal Realizations 


'The notion of minimality here is standard for linear systems and means that 
the dimension of the state-space system equals the order of some reduced 
transfer function. 

A minimal realization can be obtained directly from the input-output equa- 
tion. The notion of irreducible form is used as it is for linear time-invariant 
systems. À minimal realization is obtained when constructing a realization as 
in the proof of Theorem 2.16, or applying the algorithm in Section 2.8.1, to an 
irreducible input-output system, whenever it exists. More precisely, one has 


Theorem 2.19. Given an input-output system (2.14), assume that the con- 
ditions in Theorem 2.16 are fulfilled. Then, there exists an observable and 
controllable, i.e., minimal, realization of order k for (2.14), if and only if 
(2.14) is an irreducible input-output system. 


Proof. Given (2.14), the generating system (2.21) obtained from Theorem 2.16 
is observable. The extended system (2.15) can be written in the coordinates 
(2.23). It then reads as the composite system of system (2.24) and the control- 
lable string of integrators ù® = u^, i = 0,..., s. Thus, (2.15) is accessible 
if and only if (2.24) is controllable. The result of Theorem 2.19 follows since 
(2.15) is controllable if and only if (2.14) is irreducible, by Definition 2.6. E 


Example 2.20. Consider 
p= ğ-— ğu — yù. 
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yY 0 
yu + yù 0 ; 
Compute fe = ù and ge = ol Thus, dø, = d(y—yu) € Ho. An 
0 1 


irreducible differential form of ¢ = 0 is d$, = d(j — yu). A minimal realization 
is obtained for ¢ = 0 as 

L= xu 

yc 


2.8 Affine Realizations 


2.8.1 A Realization Algorithm 


Under the conditions of Theorem 2.16, any basis of Hs+2 defines a state 
space of the input-output system (2.14). The purpose of this section is to give 
an algorithmic construction of a canonical affine state-space representation; it 
results from a special choice of the basis for 71,42 under some special structure 
of the input-output equation. Consider the input-output equation (2.14). 


Algorithm 2.21 
Step 1. 
Let r :— k — s, then {dy,...,dy°-))} is a basis for 
A := Hs+2 Nspang {dy, j > 0) 
e If 8*o/8(u9)y #0, stop! 
e If 0p/A(u)” = 0 and d(0y(9 /Ou(9)) Z 0, define 
yii = Oy /8u(? (2.25) 


If a(y(? — ayt u) #0, define 


k 
(v) dy) 


yay" — Bui (2.26) 


yii and yj» are called auxiliary outputs. 


Step 2. l 
e If Hs42 N spany {dy{?, i > 0} =0, then stop! 
e Let {dy,...,dy°—-); dyi,..., dy ^7 be a basis for 


A51 = Xı + Hs+2 N spany (dy), i > 0) 


where ri; = dimd5; — dim. 
e If Hs+2 N spany (dy), i > 0} — 0, then stop! 
e Let (dy, ..., dy), dyi2,.-. dy»? be a basis for 
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Xz := A51 + Hs+2 N spany (dy), i = 0) 


where rig = dim, — dim. 
e If VL2 rij, dyf? € Xs, set sıj = —1, for j = 1,2. 


If Ae > rij, dy? Z X», then define s1j > 0 as the smallest integer such that, 
abusing the notation, one has locally 





M EN _ gT 09, ym, yg» u u,... ult) 
where 0 < A « r, n EN 0 € 919 < r12 + 513. 

e If si, > 0 and 07y; (rantein ) JI (u0)? #0 

or if $13 > 0 and 0? ort) jp, (s12))? #0 stop! 

e If X5 Uu = y cU, and 0?y arte f (sj ))? = 0 whenever si; > 0, 
then the algorithm stops and the realization is Mae Otherwise, define 
the new auxiliary outputs, whenever d(9yf HT [aut 513)) £ 0, respectively, 


( ) (rij 515) 
T1j 13 T 
dun ea ue 
à (rii-511) 
= 11 
y21 = Ou) 
(11) ay tei) 
Y22 Hn ce 
ay teo) 
Y23 mu Ou (s12) , ) 
(riz) dy T12 +812 
Yor = Yio” — “Bau 


Step i+1. 
From Step i, one has defined a set of numbers rj_1,; and sj 1,5; as well as the 
auxiliary outputs 


yiag = Oye TE [Bue 


(ri-1,55i—1,3) 2.27 
(ea), AM ia (2.27) 
Yi, 2j = Yi—1,j Ou i-13) 


for some j € (1,--.,2*1). 
e If D: 4n spany (dy? , £ > 0} — 0, then stop! 
e Let {dy,...,dy°—);...;dya,.. dye y be a basis for 


Xi+1,1 = A + Di N spang (dy(?), £ > 0} 


where rji; = dimAj+41,1 — dimã;. 
e If Dž N spang {dy £ > 0}=0 for j =2,...,2*1, then stop! 
e For j =2,..., 2471, let 
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r— Tij—1 
(dy, . .., dy Sdad P} 
be a basis for 
* £ 
Alu = CER E + Di N spang {dy 2 = 0) 


where Tij = dim; PS dim; 1,41. Set X41 = X Alu 

e If VE rij, dye € A41, set sij = —1. 

If Al > rij, dys) Z Xi41, then define sij as the smallest integer such that, 
abusing the notation, one has locally 





Tij Sij Tij Sij g Sij 
yt a yet YO yl) ay, u) 


ij ij 
where0 « A«r,0«o «rij t Sij. 
e If sij > 0 and ghy(r D pou Ga? #0 for some j = 1,...,25-1, stop! 
e If Xian +U = VY +U and Ory ls tm gua = 0, whenever sij > 0, 
then the algorithm stops and the realization is completed. Otherwise, define 


the new auxiliary outputs, whenever d(dy FF gu) # 0, respectively, 
(rig +823) 


Tij ə ij 
d(y£ !- Teu) #0: 


Yit1,2;-1 = Oy li Yi+1,2j = yo E: gy d u 
JS Bulsa) ? H2 9 Qui) 


End of the algorithm. 


Algorithm 2.21 yields the definition of the state (£1,..., £k) = (y, y?) 
where 0< A«r, 0« e « rij + sij. General necessary and sufficient condi- 
tions for the existence of an affine state representation are derived from the 


algorithm as well. 


Theorem 2.22. System (2.14) admits an affine realization if and only if Al- 
gorithm 2.21 can be completed, or equivalently, 


e k>s and 
92409 i 
O(uls))2 
e for sij >20 and any rij 50,151,2,:;N 49 81, ..,2^ 


(2.28) 


Ary (ris tsi) 
ij I 


where Yij, rij, and sij are as defined in Algorithm 2.21, 
e there exists a finite integer N > 1 such that 


N 
Soa +U=Y+U (2.30) 


i=l 
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Remark 2.23. Condition (2.29) is mentioned in [28, 158]. It embodies the fact 
that the input-output equation (2.14) as well as the differential equations 
relating the auxiliary outputs are affine in the highest time derivative of the 
input. 


Proof (Proof of Theorem 2.22). 

Sufficiency: Algorithm 2.21 can be performed if conditions (2.28) and (2.29) 
are satisfied. State variables are defined in the procedure of the algorithm. This 
algorithm will be completed in finite steps according to condition (2.30). Con- 
sequently, an affine, observable generating system is obtained for the input- 
output system (2.14). 

Necessity: To prove the necessity condition we need a lemma, which is partly 
contained in [28, 29, 158]. 


Lemma 2.24. If there exists a state-space system 


(inge e» 


which is a generating system for (2.14), locally around any point (yo, ..., uc) 
in some suitable open dense subset of IR"? ^l, then 92409 Iu — 0, 
dyii € spanc (dx), and dyi2 € span, {dz}. 


Proof. It is already known that 0?y“) / dus)” =O isa necessary condition for 
the existence of an affine realization of a given input-output system [28, 29, 
158]. 

The rest of the statement follows from the equality 


y 79 = LẸ ®h + [L5 * Alu 
= y12 + YU 
E 
If there exists an affine realization, then it can be transformed into the canon- 
ical structure displayed by Algorithm 2.21. By Lemma 2.24, (2.28) holds. 
Condition (2.29) follows from the proof of Lemma 2.24 which is applied to 
each auxiliary output y;;, considering all state variables in ¥j—ı as param- 


eters. The realization is observable and the dimension of the state-space is 
finite, which imply (2.30). | 


2.8.2 Examples 
Example 2.25. 
Given the input-output differential equation 


ij = u? siny cosy + ù siny (2.32) 
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for which k = 2 and s = 1, define 


r= gered) =y 
Let 
yu = sing, yı2 = y — usiny 
Then k21 = 0, k22 = 1. The relation 
Y12 = —Y12U COS yY 
implies that s22 = 0. Define 
T2 = iub cR — y12 


Then a realization of (2.32) is obtained: 


Yi = T2 + (sin z1) u 
re = —29(cos 21) U (2.33) 
y = Tı 

which is both observable and accessible and therefore it is minimal. 

Example 2.26. 


Consider the input-output system: 





uly — uy(u? — 32)? — jù = 0 (2.34) 
and write it as . 
j- ye? - i)? + fü (2.35) 


The right-hand side of (2.35) is meromorphic on the open and dense subset 
of IR?, containing the points (gy, u, ù) such that u? > ġ?. Use Algorithm 2.21 
to define 


t= yE =y 
and define the auxiliary outputs: 
E MINE OR 
y1 = —, y2 = y-—u=0 
u u 
Then, 
gu = yu (l — ya) Pu 

Define 


X12 — Uii 


A realization is obtained which has the representation: 


di = TU 
io = za(1— z2)!/72u (2.36) 
y—uu 


It does not satisfy the strong accessibility rank condition, so it is not a minimal 
realization. 
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Example 2.27. [27] 


The input-output system 





yyPu? — yut — (3g/y + 2à/u)iy?u? + 24u? 





429074? + 29?üyu — yiiy?u = 0 (237) 
can be written as 
y® = yu? + (3y/y + 2à/u)j — 2j? /? — yu? /u? 
2s PA (2.38) 
—2j^ü/(yu) + ġü/u 





and has been considered before (see Example 2 of [27]). From Step 1 of Algo- 
rithm 2.21, k = 3, s = 2. Let zı = y and define yi; = y/u. Then in Step 2 of 
the algorithm, 

"T ; ME AES E 

ju = yu + 3ynduu/y — 2yj u^ /y + ynü/y. 


So, ki — 2 and $11 — 1. Let T2 = Y11 and define 


yo = Yu — yu/y 
'Then 
Yor = (y + y11y22/y)u 
Thus zı = y, z2 = y11, and z3 = yz» yield 
v1 = rou 
t2 = 13 + (a3 /a1)u 
i3 m (zi + q313/21)u 
y = Tı 


(2.39) 


Realization (2.39) is different from the realization given in [27] which is not 
required to fit within the canonical scheme of Algorithm 2.21. 


2.9 The Hopping Robot 


Consider a hopping robot consisting of a body and a single leg, as sketched 
in Figure 2.1 . The orientation of the body with respect to the leg is actuated 
through torque u1. The length of the leg may vary with the translation of a 
piston and it is controlled through a force uz. Although the realization theory 
was developed for single input systems, it can easily be used to consider this 
two-input system. It is modeled as follows. Let m be the mass of the leg, J the 
inertia momentum of the body, r the (variable) length of the leg, 0 denotes 
the angular position of the body, and $ the angular position of the leg. 
If the action of gravity is neglected, then the mechanical equations yield 
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Fig. 2.1. Hopping robot 


mr — mro? = uo 
E JO = u (2.40) 
mr?ó + 2mrr ó = —ui 


Equations (2.40) are higher order input/ouput equations, considering the 
three outputs (r,0, à). Construct the extended system Xe defined in (2.15). 


r PO 0 0 
P re? 0 1/m 
d|989 O 0 0 0 ui 
a} é}=|o +l uus o (5) (2.41) 
$ ó 0 0 
ó EX Cuero 


The latter is not accessible and H. is spanned by (2mródr + mr?dà 4 J dà). 
this one-form is exact and equals d(mr?ġ+ JÊ). This is the kinetic momentum 
of the hopping robot and is constant. Its minimal realization has not dimension 
6. A reduced input-output representation is obtained by 


mr — mro? = u2 
mr?^ó + J0-—0 (2.42) 
mr? + 2mrró = —ui 


Apply the procedure again, compute the new extended system Xe, whose 
dimension is 5 now, and check Hao — /. A minimal realization of the hopping 
robot (without gravity) thus has dimension 5. Suitable state variables may be 
chosen as (r,7, 9, ¢, à). 
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2.10 Some Models 


2.10.1 Electromechanical Systems 


Consider an inverted pendulum of length l with a point mass m attached at 
the end of the beam, which is actuated by the torque u applied at the base of 
the beam. Let g denote the gravitational constant, and y the angular position 
of the pendulum with respect to the vertical position. Then the equation of 
motion is 

ml?^$ — mglsin o = u. 


The angle ¢ is the output. Rewriting it into the form (2.14), 
i 1 : 
p= — [u + mglsin e]. 
ml? 


Algorithm 2.21 can be applied that yields the obvious state variables zı = y 
and r9 = q. The state realization is then 


tı = T2 
$9 = -z [u + mglsin zı] 
p= 1 


2.10.2 Virus Dynamics 


Several models of virus dynamics can be found in [129]. Let us consider here 
the HIV infection and the elementary modeling of the immune system when it 
is subject to HIV infection. The immune system is based on two main actors, 
the so-called CD8 cells and the CD4 cells. The CD4 cells act as markers, they 
mark and identify the undesirable agents as viruses, bacteria, etc. The CD8 
cells act as killers. However the CD8 cells kill only agents that have been 
marked beforehand by some CD4 cell. The body is subject to many infectious 
agents, and the majority of those infections have no consequence at all. Some 
of them are agressive against specific tissues of the body and the immune 
system is able to eliminate the infection. What is unfortunate about HIV is 
that this virus attacks the basis of the immune system itself. The HIV virus 
infects CD4 cells which will no longer be able to mark the HIV virions. After 
the population of healthy CD4 cells decreases, the HIV virions will thus be 
protected against the immune system. Infected CD4 cells act as host cells and 
they produce new HIV virions. An elementary model may be derived. Let T 
denote the population of healthy CD4 cells. Let T* denote the population of 
infected CD4 cells. Let v denote the population of HIV virions. As any living 
specie, the CD4 cells have some finite lifetime 1/6. The evolution of some 
independent population is then approximated by the linear first-order system: 


T = —ôT 
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The body is assumed to produce new CD4 cells at some constant rate s; thus, 
the evolution of T in a noninfected body will be described by 


T = s — ôT 


and the population T stabilizes at some equilibrium Tọ = s/ô. In an infected 
body, besides natural death, the population T decreases due to the agression 
of the virus. Part of the healthy CD4 cells will be converted into infected CD4 
cells. It is supposed to be proportional to both the T population and the v 
population. Finally, the dynamics of T is 


T = s — ôT — Tv 


The population T* of infected CD4 cells is also submitted to a natural death, 
with a lifetime 1/u. The only source of production of new infected CD4 cells 
has already been described and its rate equals Tv. Thus, the dynamics of 
T* reads as 
T* = Tv — uT* 

The population v of HIV virions is submitted to a natural death and their 
lifetime equals 1/c. The production of new virions is proportional to the pop- 
ulation T* of infected CD4 cells. Let us exclude here the case of new external 
injection of some virus load. Then the dynamics of v becomes 


o = kT* — cv 


Problems 


2.1. Consider the following "Ball and Beam" system [166], whose input is the 
angle o and whose output is the ball position r. The input-output equation 
of the system is 


J 
0= (+m) #+mgsina — mrà? 


where the constant parameters J, R, m, g represent, respectively, the inertia 
of the ball, its radius, its mass, and the gravitational constant. 


1. Write a generalized state space representation of the system, if any. 
2. Write a classical state-space realization, if any. Hint: Apply Theorem 2.16. 
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pe 


eee 
Fig. 2.2. Ball and Beam 


2.2. Consider the same ” ball and beam” system as in Exercise 2.1 and assume 
that the angle a is produced by a torque u, so that 


a=u 


Considering u as the input and r as the output, write a classical state-space 
realization. 


2.3. Consider the following " Pendulum on a cart” system. Let m and I be the 























Fig. 2.3. Pendulum on a cart 


mass and the length of the pendulum, let M be the mass of the cart. The 
external force F applied to the cart is the control variable. This system can 
be modeled as 
(M + m)f + bf + ml6 cos 6 — ml? sind = F 
(I + ml?)@ + mglsin ð = —mli cos 0 


Considering the output y = 6, write a classical state-space realization, if any. 
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Accessibility 


3.1 Introduction 


A basic notion in control systems theory is that of reachable state and control- 
lability. Controllability concerns the possibility of steering the system from a 
state xı to another state x2. For linear systems, controllability is a structural 
property, in the sense that any linear system can be split into a controllable 
subsystem and an autonomous one. 

This is not the case for nonlinear systems, as the examples in Section 
3.2 show. The structural property that in the nonlinear case plays a role 
similar to that of controllability in the linear case and can be given a similar 
characterization is the accessibility property. 

To illustrate the notions of reachability, controllability, and accessibility, 
we will consider, in this chapter, a system without outputs of the form 


è = f(z) + g(z)u (3.1) 


where x € IR”, u € IR”, and the entries of f(a) and g(x) are elements of K. 


3.2 Examples 


'The following examples illustrate some classical pathologies stemming from 
the fact that, in general, one cannot expect a nonlinear system to be control- 
lable from any initial state to any final state. 


Example 3.1. Consider the following one-dimensional system 
t= gü (3.2) 


This system is clearly not controllable from zero: if the initial state is 
located at the origin, then the trajectory x(0,u(t)) of (3.2) remains at the 
origin for any input function u(t). 
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From an initial state xo different from the origin, it is not possible to reach 
a state zı such that 2129 < 0 since, for any continuous function u(t), the 
trajectory should pass through the origin and remain there. However, any 
point xı such that 7129 > 0 is reachable from zo Æ 0. 


Example 8.2. 
Ly = x2 


to =u 


(3.3) 


This system is not controllable from any initial point xo, in the sense that 
any neighborhood of xo contains a point xı which cannot be reached from zo. 
Figure 3.1 below shows the set of points which are reachable from zo. 


xo 


reachable points 





Fig. 3.1. Reachable set of system (3.3) 


3.3 Reachability, Controllability, and Accessibility 


The following definitions formalize the phenomena displayed by the introduc- 
tory examples. 


Definition 3.3. For a nonlinear system X of the form (3.1), the state x4 is 
said to be reachable from the state xo if there exists a finite time T and a 
Lebesgue measurable function u(t) : [0,T] > R”, such that x(xo,u, T) = 21. 


For the system (3.2), the state zı = 2 is reachable from zo = 1, whereas 
x2 = —1 is not. 


Definition 3.4. A system X of the form (3.1) is said to be controllable at xo 
if there exists a neighborhood V of xo, such that any state xı in V is reachable 
from zo. 
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The system (3.2) is controllable at any state different from the origin, 
whereas there does not exist any state xo in IR? at which the system (3.3) is 
controllable. 


Definition 3.5. A system X of the form (3.1) is said to be accessible at xo if 
the set of reachable points from xo contains an open subset of IR”. 


As illustrated in Figure 3.1, the system (3.3) is accessible in this sense at any 
point of IR?. 

From [154], the accessibility of a nonlinear analytic system at a given point 
xo of the state space IR" is characterized by the fact that the so-called strong 
accessibility distribution £ has dimension n at that point. The existence of an 
open and dense submanifold of the state space IR” at whose points the system 
is accessible is then characterized by the fact that the strong accessibility 
distribution £ has generically dimension n . 

From an algebraic point of view, accessibility will be characterized in the 
next Section using the concepts of autonomous element introduced in [136]. 


3.4 Autonomous Elements 


Let A denote the subspace of € given by X = spang {dz;, i = 1,...,n] . 


Definition 3.6. A nonzero function p in Ky is said to be an autonomous 
element of a system X of the form (3.1) if there exists an integer v and a 
nonzero meromorphic function F so that 


F(p, b, .., e?) — 0 (3.4) 
where ù = oy. 


Definition 3.7. Let p be a function in Ks such that dy € X. The relative 
degree r of p is given by 


r — inf(k € IN, such that dg? g X. (3.5) 


In particular, we say that p has finite relative degree if r belongs to IN and 
that y has infinite relative degree if r = oo. 


Remark 3.8. Note that if has relative degree equal to k, then 
span, (de, de ea 
spany (dq, do cx 


Proposition 3.9. If a function p in Ky is an autonomous element for a 
system X of the form (3.1), then 


(i) dp € X 
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(ti)p has infinite relative degree. 
Proof. Any vector w € € and which does not belong to X satisfies 
dim span (o, ...,w"-)} = k (3.6) 


for any k > 1. From Definition 3.6, this is not true for w = dọ and k = v4 1. 
This ends the proof of statement (1). 
If y has a finite relative degree, then 


dim span (do, ..., dp (^7) ) = k (3.7) 
for any k > 1. This contradicts Definition 3.6. | 


The notion of autonomous element can be defined also in the context of non- 
exact forms. 


Definition 3.10. A one-form w in X is said to be an autonomous element 
of a system X of the form (3.1) if there exists an integer v and meromorphic 
function coefficients a; in K, for i = 1,...,v, so that 


aow +... + ayw) = (3.8) 
Definition 3.11. The relative degree r of a one-form w in X is given by 
r= min{k € IN, | spang {w, ... w} ¢ X] (3.9) 


Proposition 3.12. A one form w in X is an autonomous element if and only 
if it has an infinite relative degree. 


Proof. Necessity: Assume that w in X has an infinite relative degree. Since 
dim X = n, there exists k,0 < k < n such that 


dim spany- (wu, ..., (9 =k (3.10) 


This yields that w is autonomous. 
Sufficiency: By contradiction, show that if w has finite relative degree, then 
it is not autonomous. As a matter of fact, if w has finite relative degree, then 


dim span, {w,...,.w*-Y)} = k (3.11) 
for any k > 1. This completes the proof. [| 


It is now straightforward to prove 


Proposition 3.13. The function € K and the one-form dy have the same 
relative degree. 


As a consequence, q is autonomous if and only if dy is autonomous. 


Proposition 3.14. The set A of autonomous elements of £ is a subspace of 


e. 


Proof. Using Proposition 3.12, the proof becomes straightforward. Consider 
two vectors in A; their sum still has an infinite relative degree. The same holds 
for the product of an element in A and a scalar function in Ky. E 
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3.5 Accessible Systems 


Now, let us state formally the following definition: 


Definition 3.15. The system (3.1) is said to satisfy the strong accessibility 
condition if 
A=0 (3.12) 


or, equivalently, there does not exist any nonzero autonomous element in K. 


A practical criterion for evaluating accessibility is given as follows. 

Accessibility Criterion: Computation of A 
Let us define a filtration of E, i.e., a sequence of subspaces {Hk} of E such 
that each Hk, for k > 0, is the set of all one-forms with relative degree at 
least k. 

The sequence is defined by induction as follows: 


Ho = span (dz, du}, 
Hj = {we TÉ; | we Ha]. 





It is clear that this sequence is decreasing, i.e., E D Ho 5 Hi 5 He D-::-, 
and that, at the first step, 





Hı = span {da} 
An easy consequence of the construction is the following. 


Proposition 3.16. 7(; is the space of one-forms whose relative degrees are 
greater than or equal to k. Furthermore, there exists an integer k* > 0 such 
that: 

Hk D Hey for k xk, 


Tsai = Hep = +++ = Hoo 
Has 2 Hoo 


By definition, it follows that A = Hə. The existence of the integer k* 
comes from the fact that each H, is a finite-dimensional K-vector space so 
that, at each step either the dimension decreases by at least one or Hk+1 = He. 

Systems that satisfy the strong accessibility condition get an easy algebraic 
characterization now [3]. 


Theorem 3.17. The system (3.1) satisfies the strong accessibility condition 
if and only if 
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The condition (3.13) is locally equivalent to the fact that the strong ac- 
cessibility distribution £ spans the whole tangent bundle TM to the state 
manifold M, where the strong accessibility distribution £ is defined as the 
limit of a filtration 





0CA1C..CA&C..CTM 





of involutive distributions A; given by 
Ak — gd adgg +... + ad^g 


'The remarkable fact is that the condition given by Theorem 3.17 does not 
require us to work with exact forms only. The practical construction of Hz is 
easier than that of Aj, since a low number of purely algebraic computations 
is required and no involutivity condition need to be considered. 


3.6 Controllability Canonical Form 


Although H, is in general not closed, i.e., it does not admit a basis which 
consists only of closed forms, the limit A = Hə turns out to be closed. This 
follows from the fact that locally 


ALL 
and it is stated in the following Proposition ([86]): 
Proposition 3.18. Let {w,...,w,} be a basis for A, then 
dw; Awi A... Awm =0, 1<i<r (3.14) 


From the Frobenius Theorem, there exist locally r functions, say £i, ..., Er, 
with infinite relative degree so that 


A = span (d£, ..., d£) 
Since A is invariant under time differentiation, in particular, 
& = A(&,- 6) 
: (3.15) 
& == f, Pus sr) 
Now, choosing n — r arbitrary functions, say £41,---,&n, so that 
X = spany {d&, ..., dé, } 


where X denotes span, (dx), one derives a representation, called the control- 
lability canonical form, of system (3.1) of the form 


3.7 Controllability Indices 51 


& x fite) 


&. = flee) 
EE Feary (Crees eee Uc esos (3.16) 


En = fnlns En) + Gn (Ey En) 


Note that, as a consequence of the state elimination results in Section 2.1, 
the £1,...,£, are autonomous elements that satisfy a differential equation of 
order less than or equal to r. 


3.7 Controllability Indices 


Define, now, 
hi = dim; = dimHi+1, for i Pe 1 


Moreover, hę» is nonzero and hy = 0, for any k > k*. 
The set of controllability indices (kj,..., kž,} of system (3.1) is defined as 
the dual set of {ho,...,hx«} by the relations 


hi = card(kj|k; > i} 
kj = card(hi|h; > j} for j =1,...,m 
In particular, k* 2 max{kj,...,k*,} 
Proposition 3.19. For system (3.1), 
ký +... +k% =n -— dim A (3.17) 


Note that in the nonlinear setting, the controllability indices describe only 
the structure of the accessible subsystem. It is not possible in general to display 
them as in the linear case by a Brunovsky canonical form. 


Example 3.20. Consider the unicycle described in Figure 3.2 below whose state 
representation is 
COS T3 U1 
i — | sin z3 ui 
U2 
Compute 
Hı = span, {dr} 
Hə = spang {(sin z3)dz, — (cos x3)dz2} 
H3 =0 
The controllability indices are computed as follows. hy = 2, ha =1,h3 = 0,... 
and kf = 2, k3 = 1. However, there does not exist any change of coordinates 
that gives rise to a representation containing a Brunovsky block of dimension 
2. The system is accessible; there does not exist any autonomous element. 
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Fig. 3.2. The unicycle 


Example 3.21. Consider 


di 10 
t2 X3 0 
£4 T4 0 
=e £3 (3.18) 
: n u2 
dicil Xn 0 
Tn 0 1 
Then, compute 
5 = span(zasdz, — dzo,..., 4 dz — d£n—1} 
and more generally, for 2 € k € n — 1, 
^y = spanc(zadzi — dza,..., En-k+2d£1 — dEn-k+1} 


4-1 = span {x3dx1 — dz2} 
Hn = Heo = 0 
Thus, hı 2) h2 = 1, hs S1, s hni ml hn SO and kf =n— 1, kš=1 
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3.8 Accessibility of the Hopping Robot Model 


Consider again the hopping robot of Section 2.9. 


T 


Fig. 3.3. Hopping robot 


Choosing the state variables as (21, ...,26) = (l, 1, 0,0, w, i), the resulting 
state equations are 


T2 0 0 
aes T4 0 0 ui 
f=19 +) 1/7 o a o» 
—9z2t6 —. 0 
21 mai 


The system (3.19) is not accessible, because, as remarked previously, Hoo is 
spanned by (2mazgdz + ma?dzg + Jdz4). The kinetic momentum mg? xe + 
Jx, of the hopping robot is constant and it represents a noncontrollable com- 
ponent of the state. 


Problems 


3.1. Consider the realization of the ball and beam system obtained from Ex- 
ercise 2.2 and check its accessibility. 


3.2. Compute the controllability indices of the hopping robot (3.19). 
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3.3. Consider the linear system + = Ax + Bu. Compute the spaces Hz, for 
k > 1, in terms of the matrices A and B and derive the standard controllability 
criterion for linear systems. 


A 


Observability 


4.1 Introduction 


The notion of the observability of a linear or nonlinear dynamic system con- 
cerns the possibility of recovering the state x(t) from knowledge of the mea- 
sured output y(t), the input u(t), and, possibly, a finite number of their time 
derivatives y? (t), k > 0, and u(t), 1 > 0. The structural property which 
can be easily characterized in a nonlinear framework concerns the existence 
of an open and dense submanifold of the state space JR” around whose points 
the system is locally observable. T'hus, the situation is quite similar to the one 
pertaining to controllability. 

'To illustrate the notions of observability we will consider systems of the 


form (1.4), that is, 
E = f(x) + g(x)u 
y = h(x) 
where x € IR”, u € IR", y € IR”, and the entries of f, g and h are meromorphic 
functions of x. We will sometimes ignore the presence of inputs in the system. 


4.2 Examples 


Example 4.1. Let us consider the system X defined by 


pen (4.1) 


y-c 


Clearly, for this system, it is not possible to distinguish between positive and 
negative values of the state just from knowledge of the output. We will say, in 
a situation like this, that X is not observable in a neighborhood of the origin. 
If one has the additional information that the state x belongs to an open 
neighborhood of some point xg which does not contain the origin, then its 
value can be deduced from the value of the output y by 
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x = sgn(zo)/y 


where sgn(.) denotes the sign function. We will say, then, that X (4.1) is 
locally observable around any point different from the origin. 


Example 4.2. Let q be an integer, q > 1, and let us consider the system X 


defined by 
t= g 
{ es. (4.2) 
As in Example (4.1), the knowledge of y at time t is not sufficient to deduce 
the value of x at time t. However, ý = 2274+! and so, 


0, ify=0 
“= yo. 
pyr ify #0 


In this case, we will say that X is observable. 


Further discussions and examples about the notion of observability for non- 
linear systems may be found in [45, 73, 131, 163, 164]. 


4.3 Observability 


In terms of the possibility of recovering the state, the notion that gets a nice 
structural characterization in the nonlinear context is the so-called local weak 
observability. Such a notion is defined using the concept of (in-) distinguishable 
states [73]. 


Definition 4.3. Given a system X of the form (1.4), two states x! and x? in 
X are said to be indistinguishable if, for any admissible input function u(t) 
and any initial time to, the outputs y!(t) and y?(t) corresponding to u(t) and 
to the initial condition x(to) = x! or, respectively, x(to) = x? are equal for 
any t 2 to. 


Example 4.4. Consider the unicycle in Example 3.20: 
COS X3 U1 
z= | sin z3 u1 
U2 
with output y = 21. Let x! = (0,0,0) and x? = (0,2,0). The states x! and 


x” are indistinguishable for any z € IR since 


yl (to, x1, u(t)) = y?(to, x7, u(t)) = ri cos ni wa(o)de ) ui(r)dr 


to 
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'The above definition is scarcely useful for practical purposes, since it is based 
on a condition difficult to check. It can, however, be strengthened and made 
easier to handle by imposing that the considered input functions keep the 
state trajectory inside a given subset of the state space. One gets, in this way, 
the following definition: 


Definition 4.5. Given a system X of the form (1.4), let V be a subset of 
the state space X. Two states x! € V and x? € V are said to be V- 
indistinguishable if, for any admissible input function u(t), for which the cor- 
responding state trajectories originating from x! or from x? remain in V , the 
corresponding outputs y!(t) and y?(t) are equal for any t > to 

'The above definition of V-indistinguishability does not induce an equivalence 
relation on the state space X (as the notion of indistinguishability actually 
does) since it is obviously not transitive. Let us denote, however, by Ty (x?) 
the set of states which are indistinguishable from xo. Then, we can state the 
definition. 


Definition 4.6. Given a system X of the form (1.4), a state x? € X is locally 
weakly observable if there exists an open region M C X containing x°, such 
that, for any open neighborhood V of x9 contained in M, Iy (x9) = {x°} 
Definition 4.7. A system X of the form (1.4) is said to be locally weakly 
observable if there exists an open dense subset M of its state space X, such 
that any x? € M is locally weakly observable. 


In the rest of this book, local weak observability will simply be termed ob- 
servability. From a practical point of view, this property expresses the fact 
that the state x can be recovered as a function of the output y, the input u, 
and a finite number of their time derivatives. 


4.4 'The Observable Space 


Given a system X of the form (1.4), let us denote by ¥, U, and y the spaces 
defined, respectively, by Y = span {dx}, M = spany[du(?,j > 0}, and 
y = UizoY!, where Y! = spang {dy,0 < j < i}. The chain of subspaces 


0cOs; cO, CÓ C...CÓn C ... (4.3) 


where Op :— A N (YE +U) is called the observability filtration. 
In the special case of linear systems, Op reads as 


Oy = spanc(Cdz, CAda,...,CA*da} 








If we denote by Ox the limit of the observability filtration, it is easy to see 
that 
Os, = Xn(y-cu) 


and we can state the following definition. 
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Definition 4.8. The subspace Ox C E is called the observable space of the 
system X. 


The following theorem (whose proof is left for an exercise) describes the first 
basic property of the subspace O% 


Theorem 4.9. The observable subspace Ox of X is such that 


O(y, 9, ...,y 79) 


dim Og = rankk oz 


(4.4) 


4.4.1 An Observability Criterion 


The general result characterizing the observability of a system X of the form 
(1.4) follows from [73]. 


Theorem 4.10. A system X of the form (1.4) is observable if and only if 
Os, =X (4.5) 


As a consequence of Theorems 4.9 and 4.10, we obtain the following observ- 
ability rank condition. 


Corollary 4.11. A system X of the form (1.4) is observable if and only if 


(n-1) 
esu Eod ema 


Ox 


The above rank condition reduces to the standard Kalman criterion for ob- 
servability in the special case of linear systems. 


Example 4.12. Consider the system X defined by 


dj = %2+73u 


t2 = X1 
t3 = X2 
y = Tı 


for which y = x2 + z3u and y?» = $4 + z3ü + zou. Computation shows that 


Oo = X n (Y? +U) = spang (dai) 
OQ; = X n (y! +U) = span {dzx1, dz? + udzs) 
O,—-Xn(?-c-u)-x 





Then, the system is observable, since O4, = O5 = X. Alternatively, 


iiie Deme 01u|—3 
luu 


which yields the same results. 
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A further basic property of Oæ, as a space of differential forms, is integrability. 
This is shown, without loss of generality, in the case p = m = 1 in the next 
theorem. 


Theorem 4.13. The observability space Os, of a system X of the form (1.4) 
is closed. 


Proof. Without loss of generality, assume that p = m = 1. Compute the 
successive time derivatives of the output y as follows. 


y = h(a) = a(x) (4.6) 
y is a polynomial in u: 
j = a(x) + ai (2)u (4.7) 


jj is a polynomial in u, à: 


j= X ayau (4.8) 
ij<2 
1<i<2 
732 


y 


More generally, 3 9) is a polynomial in uà U^ ... 466-175. for iji p.i + 


ikjk S slzizsjt&Es 





y = 5 E (xyum) -oe y1) (4.9) 
tiji +e + ikjk < S 
I<i<s 
j<s 
and finally, compute y~ as a polynomial in u79" . . . u=" , for i1 jı + 
stinging Sn—-li<i<n-ljg<n-t: 
yr) = DD 01. dvds (z)u 1-10 "TU ui (4.10) 
jac + ikjk < S$ 
1l<i<n-l 
j<n-1 
There are at most n independent coefficients af .. j Since 
alal (a), ..., at. (£), 
NEIN AG HEEPL OT MM NE 
Ox 
Denote ci(x),...,c,(x) those independent coefficients. Then, for any index, 
aie j may be expressed as a function oi. j of c1(x),...,c,(x). Substitute those 


expressions in (4.6), (4.7), and (4.10). The resulting systems can then be solved 
in ei(z),..., c, (x): 
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ci (a) m Cily, ù, ees y—) u, . .,u072) 


Finally, 
Ox = span(de(x),..., de, (z)] 


Example 4.14. Consider the system X defined by 


Ly = ©2%44+ rau 


rq = x9 
$3 = 0 
t4 = 0 
y= 2) 


for which y = z224 + zau, y?» = 49354 + xat, y = zor4-F z3u 2 and, more 
generally, y(9 = z5z4 + z3u(9. 
Computation shows that 


Oo = spang {dx} 
O, = spang (dzi,d( ) + udza] 
Os = spang (dai, d( )  udza, d(z224) + üdza) 
= spany (dz, d(z224), dva] 
d(zaa4) 

d(zaa4) 








Os = spang (dz, + udza, d(za24) + das, d(zo24) + u?dz3) 
= span, (dz, 


Ox = spang (dz, d(zoz4) + udzs, d(xoa4) + üdzs, . .., d(zoz4) + u*da3} 
= span (dz, d(zoz4), dva) 





Then, the system is not observable, since O5, = O2 4 X. However, letting 
ag(a) = 21, al(z) = z2z4, al (£) = £3, aĝ (£) = toma, ... 





1000 
" i 0 XA 0 X2 
O(ag(z)...., ai. (m) 0010 
rank Da = rank —— nz 3 
0.0 1 0 
: À | g-y9 
Choosing, for instance, c1(x) = z1 = y, calx) = xaz4 = Y — ————, es(x) = 
u— ù 
ý- y? ; 
z3 = , we can also write Os, = span(dei(z), dea (x), de3(x)}. 
u—iü 


4.5 Observability Canonical Form 


Given the system X of the form (1.4), its observable space Os, has the invari- 
ance property described in the next proposition. 
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Proposition 4.15. Given a system X of the form (1.4), O» C Os, +U. 


Proof. Assume that Os, = A N (V! +U) and, hence, O44 = ¥N(Y*t!+U) for 
all k > 0. Then, w € Ox implies w € X and w € (Y! +U). So, w € (X +U) 
and w € (yF*! + U) or, in other terms ù = wy + wy = wy + wy, with 
wx E€ X, wy EU, wy EU, wy € yF**, The above equality implies that wx 
also belongs to (Y*+! + U), then it belongs to Ox, and, as a consequence, 
t = wx + wy belongs to On +U. | 


Since Ox is closed, it has a basis of the form {dz1,...,dz,}. Completing the 
set {z1,..., Zr} to a basis {21,..., Zr, Zr41,---;2n} of JR”, it is easy to see, 
thanks to the invariance property shown above, that the system 2, in these 
coordinates, reads as 


A = RhG,. fase) tg. ——217 
Zp LI falzi; "n ge) pm gv (as oe Zp) 





Żr+1 = fr+1(2)  grai(z)u (4.11) 


in = falz) + gn(2)u 
y = h(z1,..., Zr) 


We will call a representation of the form (4.11) a canonical form with respect 
to observability. 


4.6 Observability Indices 


Given a system X of the form (1.4), its observability filtration 0 C Oo C O1 C 
O2 C ... C Ok C ... defines a set of structural indices in the following way. 
Let the indices c; for i > 1 be defined by 


01 — dim Oo 
Oii 
Oi-o 





gj = dim 


for i > 2. The set of indices s1, for i > 1, which is dual to the set [o;,4 > 1}, 
is defined by 
s; = card(o; such that o; > i) (4.12) 


The integer c; represents the number of observability indices s; which are 
greater than or equal to j, and duality implies that o; = card{s; such that s; > 
jt 

Definition 4.16. Given a system X of the form (1.4), the set of indices 
(51,...,55) defined by (4.12) is called the set of observability indices of X. 
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The key property of observability indices we are interested in is described in 
the following proposition. 


Proposition 4.17. Given a system X of the form (1.4), one has 
sı +... + Sp = dim O% (4.13) 


Example 4.18. Consider the unicycle described in Example 3.20, whose out- 
puts are the coordinates (x1, £2): 


yı = X1 


Y2 = T2 


One has Oo = spanę{dx1, dr2} and O, = X. Thus, cı = 2, og = 1 and 
$1 = 2, $9 = 1. 


In Chapter 6, we will construct a canonical form that displays the decompo- 
sition of a system (1.4) into observable blocks, whose dimensions equal the 
observability indices. 


4.7 Synthesis of Observers 


The use of an observer that evaluates the state from the knowledge of inputs 
and outputs is in order whenever the state itself is not directly measurable, 
but its value is required for computing a feedback or for monitoring the system 
behavior. In contrast to the linear situation, observability of a given nonlinear 
system is necessary but not sufficient to assure the possibility of constructing 
an observer. In this section, we give some results on the synthesis of a non- 
linear observer for a system of the form (1.4), which is based, on one hand, 
on linearization via output injection and state-space transformation and, on 
the other hand, on standard Luenberger observer design, performed on the 
linearized system. The main property which is required for obtaining such an 
observer is a sort of inherent linearity, which is characterized in the rest of this 
section. If such a property is absent, it is possible to investigate alternative 
design techniques, for instance, those giving rise to high gain observers [63] or 
to sliding mode observers [146], which are not considered here. 


4.7.1 Linearization by Input-output Injection and Observer 
Design 1 


Consider a system X of the form (1.4) and assume that it is a single output 
(p = 1) and observable system. As a consequence, it has a single observability 
index which equals n. Assume that it is possible to find a local state-space 
coordinate transformation (£1,...,&) = (x) such that 
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ð 
fate” =n (4.14) 
Ox 
and functions q;(y, u), for i =1,...,n, such that we can write 


& = &+ qi(y,u) 


Paci 5 En + pn—-1(Y; u) (4.15) 
y= 


The terms y; in (4.15) define a sort of input-output injection, for which a 
general definition will be given in Chapter 6. The search for the state-space 
coordinate transformation (£1,...,£5) = (x) and for the functions y;(y, u), 
for i = 1,...,n, which together allow us to obtain the form (4.15), is called 
the linearization problem by input/output injection. The solvability of this 
latter will be investigated later on. For the moment, starting from (4.15), we 
show how to construct an observer for X. 

Note that system (4.15) has the form 


ere e 
y = CE 


where (C, A) is a pair of constant matrices in canonical observer form. An 
estimate € of the state € can then be obtained from the following system: 


ê= AÊ + ply, u) + K(CÉ — y) (4.16) 


where K is chosen so that the eigenvalues of the matrix A+ KC are in the open 
left half complex plane. Thus, the estimation error Ê — € goes asymptotically 
to zero. From assumption (4.14), locally x = $^ 1(£1,...,&4,) and an estimate 
& for the state x of the original system X is given by 


ĉ = dr eis. ibn) 


Let us go back now to the problem of finding a state-space coordinate 
transformation (£1,...,£4) = (x,u) and functions q;(y, u), for i =1,...,n, 
which allow us to obtain the form (4.15). To find a solution of this problem, if 
any exists, let us assume that, by applying the state elimination technique of 
Section 2.1 to a system X of form (1.4) and by invoking the implicit function 
theorem, we get locally an input-output relation of the form 


y9) = F(gyg; xg) ,u d, a0) ud 


'Then, define a sequence of differential one-forms in the following way: 


e set Fo = F and qo = 0; 
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e fork =1,...,n, define 


Fy = Fy — QUUD (4.18) 
OF, «OOF; 
we = pe Y dg. (4.19) 


If dwk 4 0, stop. 
If duy = 0, then let yx (y, u) be a solution of 


OK v Opk 
Ox OP uec 4.2 
Dy t2 oi Uj = Uk (4.20) 


forl1<k<n-—1 and 
Qn(y, u) = Fn (4.21) 


At this point, a necessary and sufficient condition for the existence of a state 
coordinate transformation $ which, together with the functions y;(y, u) con- 
structed above in (4.21), allows us to put the system X into the form (4.15), 
can be formulated as follows: 


Theorem 4.19. Given a single output, observable system X of the form (1.4) 
and letting the function yi(y,u) for i = 1,...,n be constructed as above in 
(4.21), there exists locally a state coordinate transformation € = $(x), satis- 
fying (4.14), such that (4.15) holds if and only if 


duy = 0 (4.22) 
for 1 € k € n, where the ws are defined by (4.19). 


Theorem 4.19 is a special case of Theorem 4.21 below which will be proved in 
the sequel. 


Example 4.20. Let us consider the model of a direct current motor (DC mo- 
tor), described by the equations (see [18]) 


. Fa Rf 
tı = — mot Iia ger co Rode 
B m 
iam ie ae as ke aa (4.23) 
i3 = 0 


where x, denotes the magnetic flux and verifies xı > 0; x2 denotes the rotor 
speed; x3 denotes the constant load torque; Ra and Ry denote, respectively, 
the stator and the inductor resistance; B is the viscous friction coefficient, 
and K,, is the constant motor torque. As output of the system, to simplify 
the computations, we choose the natural logarithm of 71, y = In(zi). Since 


x 
y= = substituting e" for xı, we get 
Tı 
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Rat Ry 
K 





y = e” (—Kme” r2 — K 


u) = — Karo +ue™” (4.24) 


B Km sty ye 
yO = —Ky,(—= - z2 — r3 + —. Ke?!) + üe^" — ue Vy (4.25) 











J J 
KmB 2 K 
(3) — 49—2 = ey pu) eT —2üe-Vg--ue- "ij? —ue y? (4.26 
y j y 
From (4.25), 


B Km 1 aes yy 
C7 : 422 — X3 + a -K. e?) = an ee + ue y — ue Yy) (4.27) 


m 


and, by substituting in (4.26), we get the input/output differential equation 


B 
y® =F py hea Da > ye 9 — ue y) 





(4.28) 
- ej + uP eT — 2üe- Vj + uey? — ue Yy 
oF B OF 
= y uyQO an i u2): C Se yo ee ae 
Let F1 = F(y,y,y, u, ù, uV?); then aa I u”, aay =e and, 


B 
by (4.19), w1 = (77 — ue ")dy + e * du. Now, w is an exact one-form, since 


B 
wi = dpi(y,u), with pi(y,u) = ——y + ue ?. 





J 
Following (4.18), define 
Fy(y, ý, u, à) = F(y ġ, yu, tu) — e» y. u) 
B Keak 
=e (ùe™” — ue Yy) — 2 an e?» j 
OF. B K2? K OF, B 
Then, 2 = -Z ye” —2 pu Ed o eee 
em By rl Ue Or gue 


2 





B 
e?")dy + (F e ¥)du 


Now, wə is an exact one-form because wz = dpe(y, u), with 


B 
and w2 = (—7 we¥—2 





B K2 K 
paly u) = ue ta e” 
OF: OF: 

Define F3(y,u) = Fo(y, d, u, à) — £O (y, u) = 0 . Then, a =0, 2 = 0, 
w3 = 0, and y3(y,u) = 0. 

The change of variables 

1 = In(z1) 
Ra + Ry 


B 
£2 = —Km T2 + ; he) = 
B Ra + Ry 


Km = 
£3 = t3- 1 —K 
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now yields the canonical form (4.11) 


& =&+ vily,u) 
&2 = 63 "E pa(y, u) 
&3 —0 
y-6 





4.7.2 Linearization by Input-output Injection and Observer 
Design 2 


'The problem considered in Section 4.7.1 can be extended by looking for a gen- 


eralized state-space coordinate transformation (£1, ... , En) = $(r,u, à, ... ,u(?)) 
such that m 
ank— = 4.29 
rank;- =n (4.29) 
and functions q;(y, u, u,...,u)), for i= 1,...,n, such that we can write 


& — £2 + iy, u, ù.. .,ul)) 


£i = En + nca (y i sss. 0) (4.30) 


En = Qn; u, ù, MACROS) uls)) 
y-& 
The terms y; in (4.30) are a special form of input-output injection and an 


observer can be computed from (4.30) as follows. 
Note that system (4.30) has the form 


uw TM 
y = C6 


where (C, A) is a pair of constant matrices in canonical observer form. Then, 
an estimate € of the state £ is obtained from the following system: 


E AE cu dcm DICE y) (4.31) 


where K is chosen so that the eigenvalues of matrix A + KC are in the open 
left half complex plane. Thus, the estimation error Ê — € is asymptotically 
stable. From assumption (4.29), locally x = @71(€1,...,€n,u,t,...,u%) and 
an estimate ĉ for the original state x of system (1.4) is given by 


£= TLE, oa, En u, TROU 


Let us go back now to the problem of finding a generalized state-space 


coordinate transformation (£1, . . . , En) = (x, u, u,...,u%)) and a set of func- 
tions y;(y,u,u,...,u)), for i = 1,...,n, which allow us to obtain the form 
(4.30). 


To this aim, let us consider the following sequence of differential one-forms. 
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e set Fo = F and qo = 0; 
e fork =1,...,n, define 


Fy = Fa i 2 (4.32) 


Fk du‘) 
Wk = Oy a k) dy + 2 xS (n— TEES (4.33) 


Denoting shortly ndut? ^ dus? ^ A duQ by mens if duy ^ du A dù- +- ^ 
du -? 4 0, then stop. 

If, otherwise, duy ^ du ^ du---A du) = 0, then let p(y, u, ù,- ,u (9?) be 
a solution of 


opk c. Bpk 4 (s) _ 
Əy yt y» WO = Uk (4.34) 
j-l 7j 
for 1 € k € n — 1, and 
Q» (y, u, ù, ul) = Fn (4.35) 


A necessary and sufficient condition for the existence of a generalized state co- 
ordinate transformation (€,...,€n) = o(x,u,u,...,u)) that, together with 
the functions q;(y, u, à,..., u 9) constructed above, allows us to put the sys- 
tem X into the form (4.30), can now be formulated as follows: 


Theorem 4.21. Given a single output, observable system X of the form 
(1.4) and letting the function qi(y,u,à,...,u(9) for i = 1,...,n be con- 
structed as above, there exists locally a state-space coordinate transformation 
(&£1,..., En) = O(x,u,t,...,u), satisfying (4.29), such that (4.30) holds if 
and only if 

duy ^ du ^ dü--- Adu) = 0 (4.36) 
for 1 € k € n, where the ws are defined by (4.38). 
Before proving Theorem 4.21, let us consider an illustrative example. 
Example 4.22. Let X be the system defined by the equations 


ti = T2 u? 


49 =0 (4.37) 
y= 


The input-output differential equation of X is 


(2) 





y" = Fy, 9, u, ù) = (4.38) 
For s = 0 or s = 1, conditions (4.36) are not satisfied, i.e., the lineariza- 
tion problem cannot be solved by a state coordinate transformation and in- 


put/injection functions that do not involve time derivatives of u of order 
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greater than 1. Taking s = 2 and applying the above procedure, one gets 
Fi = 2yu/u. The differential form w4 given by (4.33)is 
OF, OF, 2ü 


wy 9j y+ 5.5) 48 = | dy (4.39) 


and condition (4.36) of Theorem 4.21 is satisfied for k = 1, since 
dw, ^ du ^ dù = 0 


The function yi(y, u, à, à) given by (4.34) is 


mee 2y: ù 
pry, ty ty ti) = ZE (4.40) 


For k = 2, Fy = 2(ü?/u? — ü/u) - y, and the differential form w2 is 


_ 2P 


OP. 
W2 = dip 


Oy Ot 


. 2 m 2 
dü = (5 — “jay - Sait (4.41) 
u? u u 

Again, condition (4.36) of Theorem 4.21 is satisfied and the function ya(y, u, ù, it) 
given by (4.34) is 

à d 

2 — 2(— Beg (4.42) 

u? u 
Then, we have the generalized state coordinate transformation (1,2) = 
(21, xQu” — 22, - à/u), and we can write 





& s= é+ Zu 
: 2 .. 
& 23055 E) P 


y=&1 


Comparing with (4.15), an observer for X can now be constructed as shown 
in Section 4.7.1. 


Proof (Proof of Theorem 4.21.). 

Necessity: Suppose that there exists a generalized state coordinate transfor- 
mation £ = ¢(a,u, t,:--,uS—)), satisfying (4.29), and functions q;(y, u) for 
i — 1,...,n such that (4.30) holds. Then, we can write 


y? = F(E, u, ù, oes uls—1)) 


n—-1 n—2 
— er Dey De gpn 


'Therefore, we have 


Fı = Fo 
861 (n—1)_, NO 91, (n-143) Er E 
LL o vee YOT) au sss yat) 
Oy y + by du‘ uj F 1(y, (y ;U, QU ) 





j=l 
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and the differential form w1, according to (4.33), is given by 
= ul?) 
v (n— 0-1) dy + vee 1 Qu 2o D d 


_9 T 
baar Ba 


Then, the condition dw; ^ du ^ dù ^ ++- ^ du6-U = 0 is satisfied. The proof 

for steps 2 < k < n follows the same lines. 

Sufficiency: Assume that the condition (4.36) is satisfied and let yz (y, u, à, - - , u“)) 
be given by (4.34). From the definition of y1,..., 5.1, 


& = Gua + Yi, fori=1,....n-1 


Computing Ens one gets 





& = y? — o, - e, Ls uf (4.44) 
and, finally, from (4.36), (4.32), and (4.34), y) = gn + oO) + +PP. 
Therefore, én = Yn, and the result follows. [| 


Problems 


4.1. Given a system X of the form (1.4), show that the equality O. = ¥ N 
(Y +U) holds. 


4.2. Given a system X of the form (1.4), prove that 


i (n—1) 
Dis cessante EEG (4.45) 
HH 


4.3. Consider the linear system 


z= Ax + Bu 
y=Cx 


Compute the spaces Y^ and Ox, for k > 1, in terms of the matrices A and C, 
and derive the standard observability criterion for linear systems. 


5 


Systems Structure and Inversion 


Given a system X with input u and output y, the idea of designing an inverse 
system X71, whenever it is possible, is quite appealing, since the inverse sys- 
tem may provide a way to compute the control input u(t) that is required to 
obtain a (desired) output y(t) from X. The notion of inverse system is intro- 
duced and discussed in this chapter, as well as that of an inversion algorithm. 
Minimality of inverse systems is considered as well and it is discussed in the 
light of the intrinsic notion of zero dynamics. This, in turn, is shown to play 
a key role in stabilization problems and in output tracking problems with 
internal stability. 


5.1 Introductory Examples 


5.1.1 A Resistor Circuit 


Let X be a static system (i.e. consisting only of algebraic equations), whose 
input u and output y represent, respectively, the voltage and the current in a 
resistor R. 


Fig. 5.1. Resistor circuit 


The input-output equation of X is 


y = (1/R)u 
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Its inverse system XT! operates generating its “output” u(t) from the “input” 
y(t) and it is easily defined through its input-output equation 


u= Ry 


Clearly, one can use X! to determine the input required to force the system 
X to produce any desired output. 


5.1.2 An Induction-resistor Circuit 


Now let X denote the series connection of an induction element L with a 
resistor R. The input u(t) represents the voltage and the output y(t) represents 
the current in the circuit. The input-output equation of X is y = —(R/L)y+u 
and a state-space realization is 


issues 
y-z 


An inverse system X! should take y(t) as input and it should produce u(t) as 
output. A candidate inverse system can be described by the set of equations 


z=y 
u=(R/L)z+y 
z(0) = x(0) 


A different candidate, however, may be described in a simpler way by the 
equation 
u = ġ + (R/L)y 


5.2 Inverse Systems 


To discuss the notion of system inversion in general terms, let us consider a 
system X of the form (1.4), that is, 


_ [t= f(x) + g(x)u 
5s o (5.1) 


where x € IR”, u € IR", y € JR”, and the entries of f, g and h are meromorphic 
functions of x. 





Definition 5.1. Right inverse The system 
z sas FOS9 2. yy) 
nee 62) 


is a right inverse system for X if there exists z(0) such that the output y(t) of 
(5.1) equals the input y(t) of (5.2) whenever the input u(t) of (5.1) is chosen 
as the output of (5.2). 
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Fig. 5.2. System X 


Right inverse 





Fig. 5.3. Right inverse system 


'The definition of a left inverse is obtained essentially by interchanging the 
roles of (5.1) and (5.2). 


Definition 5.2. Left inverse The system 
z m 2 Ca S T sy) 
ME x 


is a left inverse system for system (5.1) if the output u(t) of (5.3) equals the 
input u(t) of (5.1) whenever the input y(t) of (5.3) is chosen as the output of 


(5.1). 


Left inverse 





Fig. 5.4. Left inverse system 


5.3 Structural Indices 


To handle the problem of constructing, if possible, the inverse of a given sys- 
tem, we need to introduce a number of tools and notions related to structural 
properties. To begin with, let us recall that our study of accessibility was 
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based on the notion of relative degree, given in Definition 3.7, of a function, 
that may be viewed as an output. In this case, the relative degree represents 
the delay existing between the control input and the output function. More 
precisely, it is the order of differentiation which has to be applied to the output 
to have explicit dependence on the input. From this point of view, this notion 
describes the so-called structure at infinity in the single output case. More 
generally, the structure at infinity of a nonlinear system displays, roughly 
speaking, the delay structure existing between the input and the output in 
the multivariable case. In this section, the structure at infinity of a nonlinear 
system will be formally defined and studied, and an algorithm for computing 
it will be introduced. 


5.3.1 Structure at Infinity 


Given the system (5.1), one can naturally associate with X the chain of sub- 
spaces Eo C E1 C ... C En of € defined by 


Eo = spang {dx} 


(5.4) 
En = spany (dz, dý, . .., dy?) 


Definition 5.3. Given the chain of vector spaces (5.4), the list of integers 
[ox, k — 1,...,n) defined by 


Ek 


Ok = dimy 
Ek. 1 





(5.5) 


is called the structure at infinity of X. 


The list given by (5.5) contains structural information on the system that 
plays a crucial role in the solution of many control problems ([22, 42, 132]). 
The list {s,,k =1,...,n}, defined by 


81— 01, Sk — Oy — Og 1, k —2,...,n (5.6) 


describes the so-called zeros at infinity of X as follows: 


e sı is the number of zeros at infinity whose order equals 1; 
e s; is the number of zeros at infinity whose order equals 7. 


In relation to the structure at infinity, two more lists of integers can be con- 
sidered. 


e (ni,..., Np}, where nj is the the relative degree of the output component 
yi; each n; is said to represent the order of the zero at infinity of the output 
component with which it is associated; 
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e. (nj... np}, the list of integers obtained by duality from (sy, k = 1,...,n} 
(i.e., from the relation o; = card(m; | n; < ij)); such a list is said to 
represent the orders of the zeros at infinity of the system. 


One more notion will be used in the following. 


Definition 5.4. The essential order nie of the scalar output component yi is 
defined by 
Nie = min{k € N | 


. B a 5.7 
dy € spanyc(dz, dy,...,dy@-, dy, dg i dy ty Ent) 


To make the meaning of these various lists of integers clearer, let us consider 
the following example. 


Example 5.5. Let X be the system defined by the equations 


tı = u1 
t2 = £3U1 
t3 = ug 
Yı = Tı 
Y2 = T2 


Computing the derivatives of the output, we get 


yı = u 
Yo = T3u1 = T391 
Then, (n1, n2} = (1, 1}, since a component of the input appears in the first 


derivative of both output components. However, to get all the components of 
the input, we have to derive gj» further. 


Yo = d$aji- vali = udi + vali 
Then, (n4, n5) = (1, 2}. Now, let us compute the subspaces (5.4) associated 
with the system X. 
Eo = spang {dz}, £i -—spanyc[dz,dui], E2 = span (dz, dui, dà, dua) 
Hence, cı = 1 and ce» = 2. We have also that nie = 2 and noe = 2. 


Note that for a single-output system the relative degree of y = h(x) equals 
the order of the zero at infinity of X. 
'This fact motivates the following definition. 


Definition 5.6. The relative degree of a single output system X is the relative 
degree of its output function. 


A general algorithm for computing the structure at infinity of a given system 
is discussed in Section 5.4. 
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5.4 Structure Algorithm 


The structure at infinity of a given system can be computed by applying 
a suitable algorithm, called the structure algorithm, that turns out to be a 
fundamental tool in the analysis of nonlinear dynamic systems. The structure 
algorithm was first introduced by Silverman for linear time-invariant systems 
[144], and it was then generalized to nonlinear systems in [74]. Then, Singh 
further extended it in [145] and finally it appeared in [42] in the form we will 
present hereafter. 

'The structure algorithm is also known as the inversion algorithm, or Singh's 
inversion algorithm, since, when a system is invertible, it allows us to express 
the input as a function of the output, its time derivatives and, possibly, some 
states. Thus it may be viewed as an algorithm that directly computes the 
input necessary for generating a desired output function. 

Control methods such as trajectory tracking or computed torque control in 
robotics are special applications of the inversion algorithm. 

To describe the algorithm, assume that a system of the form (5.1) is given. 


Algorithm 5.7 (The Structure Algorithm) 











Step 1. 
Compute 
j= (ga) +ga) 
and write 
ale) = ZO F(a) 
b (x) = PA qq 


Then, y = a1(z) + b3(x)u. Define 
pı = rank b; (x) 


Permute, if necessary, the components of the output, so that the first py rows 
of bi(x) are linearly independent over K. Denote by y; the vector consisting 
of the first py rows of y, and denote by à, the other p — pı rows, so that 


-() 
Yı 
Since the last rows of bı(x) are linearly dependent upon the first pı rows, we 
can write ] Lr 
y, = ài(z) + bi(w)u 
th = (2%) 


where the last equation is affine in i4. Finally, define 
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Step k+1. 
Suppose that in Steps 1 through k, Üa, ss gg have been defined so that 


li = a(x) + bi (x)u 


e NEC : | . (5.8) 
jt? = arle, ġja ders. T de a) ig ut 
ra Bs ~(k—-1 E 
+b, (x, d.d 2 UR yu 
a(k a(k E ~(k T 7 
LA Lun FbaE 


For every i, j, and k, my ) and 9 nu are meromorphic functions in K. 
Suppose that the matric By := Lu -,bF]T has a full row rank equal to pp. 
Then, compute 


~(k-+1) age” a g(t) 
Y = -gr ele u] + ST 


j=l j—i Du 
and write it as 


OY —asa(zgPcizkiczjzk-l) 


torpile, gP, 1 <i<ki<j<k)u 
Define By41 := [Beer and 


Proi := rank By44 


Permute, if necessary, the components of 4, (D so that the first pk+1 rows of 
Brit are linearly independent. Decompose JED as 
~(k+1) 
TS Yk+1 
Un x 
(R41) 
Yk+1 








where v consists of the first (py.1 — pk) rows. Since the last rows of By 4 


are linearly dependent on the first py.,1 rows, one can write 
ji = ài(z) + bı (a)u 


JETP = Gaye, 9 1 <i k, i<j k+l) 


tirpi, gP, 1<i<k, i< j< ku 
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Wa HSM IP ACES RA LISI ERED). GW 


Finally, set Bhai :— [BT uat: 
The algorithm stops when 


rank[O(y, i, a Ena )]/8x = mn rank|[O(y, th, oat Eu ))]/ðzx. 
End of the algorithm. 


Assuming that Algorithm 5.7 stops at step k, the orders of the zeros at infinity, 
as well as the essential orders, may be computed from (5.9). The list of the 
orders of the zeros at infinity is given by the list of the smallest orders of 
differentiation of y;,i = 1,...,p that occur in (5.9), and the essential order 
Nie equals the largest order of differentiation of y; in (5.9). 

Actually, the structure algorithm computes a basis for the chain of subspaces 
(5.4). 


Theorem 5.8. /42] A basis for £y is given by 
{da dj. Seres di ius dit co ag”, dit?) 


Proof. Note that for k = 1, {da,dy,} is a set of generators of £4 since 
dj, € spany (dz, dy,}. Since bi (a) has a full row rank, the set also consists of 
independent vectors and it is thus a basis for £1. The rest of the proof may 
be done by induction and is reported in [42]. | 


It follows from the above theorem that the two lists (ox, k = 1,...,n} and 
{pk,k =1,...,n} coincide. 


Definition 5.9. The integer pn obtained by Algorithm 5.7 is called the rank 
of the system X. 


5.4.1 A Pseudoinverse System 


A so-called pseudoinverse system X^! can now be constructed by Algorithm 
5.7. Assume that the algorithm stops at Step k, then the matrix By, has a full 
rank equal to p, and rank By = rank Bry, =+- = rank By. 

Then, the first p components of u, say (w1,---,U,), can be obtained by solving 
the system (5.9), and we can write 


ui 
= F(z,d, y uas Um) (5.11) 
Up 


for some suitable function F. 
The system X-! will be defined as follows. 
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F(z,g,-: y upg, +++, Um) 


: Up+1 
ż =f@)ta(2) | 
A Um (5.12) 
U1 
x F(z,g, y Upgis +++, Um) 
Up 


In the special case of square invertible systems (i.e. py — m — p), the system 
(5.9) has a unique solution u; therefore, an inverse system XT! is uniquely 
defined. 


5.4.2 Examples 


Example 5.10. Consider the unicycle in Example 4.18. The inversion algorithm 
5.7 yields 


ji = (cos zs)ui (5.13) 
Y2 = (sin z3)u; = (tan z3)j1 (5.14) 


The second step of Algorithm 5.7 gives 
jj = (tan z3)ij + (1/ cos? z3)g1u» 
and the algorithm stops. The input is then obtained as 


uj = j1/ COS x3 
[ü — (tan vs)ji] cos? x3 (5.15) 


uo = 
yı 


A pseudoinverse is thus obtained as 


a= 
29 = (tan Z3) 
. [Uo — (tan z3)%1] cos? z3 
gai. | is s ———É—— 
4 : Ui 
ui = ğı / cos 23, 
[jo — (tan 23) 1] cos? za 
yı 


(5.16) 


uo = 
Step 1 of the Structure Algorithm may be performed in a different way, writing 


j = (sin z3)u1 (5.17) 
ji = (sin za)u; = (cot £3)ý2 (5.18) 


A different pseudoinverse is then obtained as 
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G = Y2 cot C3 
C2 = Ye 
» _ [Ua cot G3 — di] sin? Cs 
bye : (3 = S20 ee S. (5.19) 


ui = Yo/ sin C3 
[Uo cot C3 = iA] sin? C3 
Y2 
The space E, admits the basis (dz, dj1) and the space E2 admits the basis 
{dax, dij, dii, dy2}. The unicycle has one zero at infinity of order 1 and one 
zero at infinity of order 2. Both essential orders equal 2. 


Example 5.11. Consider the following system with two inputs and one output. 
Ly = XQu, + ug 
T2 = U2 (5.20) 
y =T 
The Structure Algorithm yields y = x2u4 + u2 which can be solved either in 
ui or in ug. In one case, one gets the pseudoinverse Xi 
a=y 
5I: | ż2 = 9-20 (5.21) 


u2 = Y — z2u1 


and in the second case, the pseudoinverse X; ! is obtained 





G-j 
=L} C2 = U2 
A5 : i tss (5.22) 
1 = 
C2 


Different (pseudo-)inverse systems can be obtained by choosing different 
components for jg in the Structure Algorithm 5.7. This can be seen also in 
the case of the unicycle in Example 4.18. 


Step 1 of the Structure Algorithm may be performed in a different way, writing 
Yo = (sin zs)ui (5.23) 
ji = (sin za)u; = (cot £3)ý2 (5.24) 


Thus, a pseudoinverse, different from (5.16), is obtained: 


Gi = Y2 cot G3 
C2 = ja 
X [Uo cot C3 = i1] sin? C3 
pole (5.25) 


ui = tja / sin C3 
[Uo cot C3 = i1] sin? C3 
UP 
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Example 5.12. Let us continue with the example of the unicycle. Both in (5.16) 
and in (5.19), the output of the inverse system depends only on the third 
dynamic. Thus, 


[Us — (tan 23)]1] cos? z3 


z3 = - 
-1 : Uu 
Xir =: | uy = ġ1/ cos 23 (5.26) 
- d "m 
m Leder 


is a (reduced) inverse system as well as 
= [la cot Cs — th] sin? C3 
Y2 
D5, : | u = 92/sin C3 (5.27) 
[Uo cot C3 > iA] sin? C3 
UP 


Moreover, the relation z3 = arctan(y2/y1) obtained from (5.14), where z3 has 
been substituted for x3, allows us to obtain a static (dynamic-free) inverse: 


m= YVES, 
_ ota — Vids] 
We Er 
yi tuv 
The same result can be obtained by eliminating ¢3 in (5.27). 


Example 5.13. Consider again the circuit of Section 5.1.2 


no pu 
y-z 


The Structure Algorithm provides y = —(R/L)z + u and the inverse system 


Pg 
u — (R/L)z & 
2(0) = z(0) 


However, since we have y = x from the system’s equations, a static, state-free 
inverse system can be obtained as 


u- ij (R/L)y 


5.4.3 Reduced Inverse Systems 


From the last Example, it is clear that the complexity of inverse systems 
obtained by (5.12) may be reduced [165]. In this regard, we have the following 
result. Let us denote by H the matrix 
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h(x) 
" " 91 (x, 91) 
Hege = |. (5.28) 
a(k z ~(k ~(k 
D (m, d4,..., i HN. ? 


whose rows are given by the output equations of system (5.1) and from the 
inversion equations (5.9). 


Theorem 5.14. Given the system X, there exists a pseudoinverse of dimen- 
sion 


s =n—rank— 


Ox 
Proof. Consider the set of equations 
H(2,%,,---,9) —9 =0 5.29 
(2,34; UE ) y ( z ) 
where H is the matrix (5.28) and 
Y 
uM 
ae 


Substitute z; for x; for i = 1,...,n in H. Without loss of generality, assume that 
the n — s first rows of OH /0z are independent and denote by H the (n — s) di- 
mensional vector consisting of the first (n—5) components of H (2,44, :, iO). 
Without loss of generality, we can also assume that 
OH 
rànk———————— = n- s 


O(21, ..., 2Zn—s) 
By the implicit function theorem, we can solve in (21, ...,2n—s) the equation 
lag s ~(k = 
H(z,di, d )-g-0 
where jg is the vector consisting of the (n — s) first components of ĝ. Thus, 


zl 
= Ë (zn-s41; 2m G10 HY) (5.30) 


2n—s 


for some suitable function H. Rewrite (5.12), removing the n— s first equations 
of the dynamic 2. In F(z1,...,z4 5,2n — S$ + 1,..., Zn; Q, sy, Ups, Ug), 
substitute (21,..., 25.) using (5.30) to get the reduced inverse system Sj! 
defined by the equations 
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A Fn auda J, Ù, a i Um) 
n—s+1 5 pl 
| =f +50) | 
m Um (5.31) 
U1 
E P2 d. sees Zn, 9, UA pli Um) 
Up 


where f(-) = f(za-sti, 52 4, 0) and §(-) = G(zn—e41;--. 22,9, 9)- Eg. is 
the desired reduced inverse of dimension s. | 


5.5 Invertibility 


We can now state the main results about the existence of inverse systems. 


Definition 5.15. System (1.1) is said to be left- (resp., right-) invertible if 
there exists a left (resp., right) inverse system according to Definitions 5.2 
and 5.1 respectively. 


Proposition 5.16. /51] System (1.1) is left- (resp., right-) invertible if and 
only if its rank p equals m (resp., p). 


Example 5.17. Example 5.10 continued. 
From (5.15), a left inverse system of the unicycle is given by the equations 


j — lla — (tan mii) cos? y 
: yi 

uj = y1/ cos N 

lis — (tan nöi] cos? n 


uo = 
yı 


From (5.14), z3 = arctan(y2/y1) and thus, replacing za by 7, a static inverse 
system is given by the equations 





w= Vy y 
"S Yiy2 — Ul 
2—795 9 
jit d 


Example 5.18. Consider the linear system whose transfer function equals 
(s 4- 1)/s? and in state-space form reads 


tı = T2 
t2 =u 
y = £1 + T2 
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The inversion algorithm yields y = x2 + u and thus, a "reduced" inverse [165] 


is f | 
{ --ntg 
u=—nt+y 
In the linear case, the existence of a reduced inverse system, as it happens in 
Example 5.18, is explained by the presence of one transmission zero. In the 


non linear case, the situation is more complicated but, nevertheless, interesting 
relations have been established. 





5.6 Zero Dynamics 


In the nonlinear context, there exist three different notions that generalize 
the concept of transmission zeros of a linear time-invariant system, as it is 
shown in [88]. A fundamental one is the notion of zero dynamics that can be 
introduced by reduced inverse dynamics, as defined in the previous section. 
To clarify the situation, we start by a particular case, under the following 
assumptions. 


Assumption 5.19 System (5.1) is minimal, i.e., observable and accessible. 


Assumption 5.20 System (5.1) is square invertible. 


Assumption 5.21 The trajectory y = 0 is not singular for the reduced in- 
verse 


n-ti 
: = f(Zn—s41) 5 Zn U9) 
Zi z 
Ns : +G(Zn—s+41, sey Zn, J, 9) | F(zn-s+1, vu Zna y. )] 
U1 
= F(Zn—s41; ks Sas Us $) 
Um 
(5.32) 
The dynamics 
Zn—s44 
: = f (Zn—s41) ++) Zn 0, ..., 0) (5.33) 
Zn 


+G(Zn—s415 5 20,0, ., 0) F (2n—s41, ++) Zn; 0, ...,0) 
are well defined. 


Definition 5.22. The zero dynamics of system (5.1) is defined by the dynam- 
ics (5.93) of a reduced inverse driven by y = 0. 


5.6 Zero Dynamics 85 


By the structure algorithm, we can immediately obtain the following: 


Proposition 5.23. If the system is invertible, then the dimension of the zero 
dynamics equals 


e n— Suc ni, where the m; denote the orders of the zeros at infinity, 
e dim% — dim(X n). 


Examples 


Example 5.24. Given the linear system 





tı = T2 

t2 = £1 + £2 +U 
$3 = 0 
Y= Tı T T3 


1 
whose transfer function is aT the inversion algorithm gives 
s? —s— 


Y = 22, y® =a, +r2+u (5.34) 


Because p = 2, the system is invertible and the inverse system is given by the 
equations 


2 = 22 
Z2 = y? 
Z3 =0 


Equations (5.29) are, in this case, y = 21 + z3 and y = zs. Solving with 
respect to xı and x2 and substituting z; for x;, for i = 1,2, we obtain 


ài 
i = y?) 
i3 =0 


u=y —y—ytzs 


The reduced inverse is therefore 


me 
u— y? —4g—yt zs 


whose transfer function is s? — s — 1. 


Note that this is an inverse system in the sense of Definition 5.2, since the 
substitution of y and y in u = y)? — à — y + 23 yields u = u — 23 + 23. Pick 
23(0) = xz3(0) and the result follows. 

A minimal realization of the transfer function s 
system 


? - s — 1 consists of the static 


u=y) -g-y 
which is not an inverse system in the sense of Definition 5.2 since the substi- 
tution of (5.34) in u = y) — ġ — y yields u = u — z3. 
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Example 5.25. Consider the system 


tı = £to +U 


t2 = —x? — u” 
Y= 2 
The inverse system is 
ži =ğ 
ža = =z] — (y — 22)“ 
U=Y 22 


Substitute y for z; and get the reduced inverse system 


te = —y? — (y — 22)* 


U=Y- z2 
Set y = 0, and the zero dynamics is obtained as 
fa = (1g 


Example 5.26. 


Tj = T2 

t2 = £1 32d Uu 
$3 —0 

yY = T1 : T3 


The inversion algorithm yields 
d) Y =21-2%3 
b jy =22-23 (5.35) 
c) y? = (a1 + z2)£3 + uxs 


For x3 4 0, the inverse system is 


21 = 22 
(2) (2) 
es ys dead Poe ae eee 
23 23 
3 =0 
yO 
u = — — Z1 — 22 
23 


By solving with respect to zı and x2 (5.35 a and b), we obtain 


20 
zı = — 
MC 
b nog 
z2? —— 
23 
23 =0 
| 40 - d-y 
TES SHREK ROC 


23 
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The reduced inverse is therefore 


iste 
codes ag 
£3 


u 


Note that the input-output equation of the system is 





alg — ý — y] — uly — j- 3] = 0 


Since u Æ 0, it is equivalent to YYY . 0. This is not a well-posed 


u 
system because no notion of minimal realization applies and no notion of zero 
dynamics applies. 


Problems 


5.1. Show that an accessible and observable single output system X has a 
finite relative degree. 

Hint: The output function y — h(x) cannot be zero, and it cannot be an 
autonomous element of Ky. 


5.2. Given the system X defined by 


tı = u 
i» = @3U1 
L3 = L4uy 
. (5.36) 
Tn—1 = Tnu 
Ln = U2 
yı = Tı 
y2 — x2 
compute 
1. the order n; of the zero at infinity of each output component, yi; 
2. the list of orders of the zeros at infinity; 
3. the structure at infinity; 
4. the rank. 
5.3. Is the system X defined by 
dj = T2U1 + U2 
t2 = u1 (5.37) 


y—m 


right (left) invertible? In case of a positive answer, compute an inverse. 
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5.4. Is the system X defined by 


Ly = QU 

t2 = T3 

é3 =u (5.38) 
yı = Tı 

Y2 = x2 


right (left) invertible? In case of a positive answer, compute an inverse. 


5.5. Given the linear system X defined by 


di = T2 
bo =u (5.39) 
y = tı + T2 


compute its zero dynamics. 
5.6. Given the linear system X defined by 


tı = T2 
t2 =u (5.40) 
y = Tı — T2 


compute its zero dynamics. 
5.7. Given the system X defined by 


tı = ils + rou 
t2 = zu (5.41) 
y = 2 


compute its zero dynamics. 


6 


System Transformations 


The study of dynamic properties is often simplified by the possibility of modi- 
fying the representation of a given system into some sort of special, or canoni- 
cal. For linear systems, the class of transformations one can use includes state- 
space isomorphisms, static state feedbacks, and output injections. In dealing 
with nonlinear systems of the form (3.1) from a differential algebraic point of 
view, it is useful to enlarge this general class, allowing transformations that 
involve, together with the state, also inputs, outputs, and their derivatives. 
In this way, it is possible to obtain a canonical form that generalizes, up to a 
certain extent, the well known Morse canonical form for linear systems (see 
[123]). It is possible to decompose a given systems into subsystems having 
specific dynamic properties so that the analysis of the system structure is 
simplified. 

To describe how such canonical decomposition can be obtained, we introduce 
in this chapter the notions of generalized state-space transformation, regular 
generalized state feedback, and generalized output injection. Regular general- 
ized state feedbacks can be viewed as a special case of quasi-static feedbacks, 
which have been described and studied in [30, 32]. 


6.1 Generalized State-space Transformation 


The notion of generalized state has been introduced in connection with dy- 
namic representations involving a finite number of derivatives of the input 
and that arise as solutions of the realization problem in a differential alge- 
braic context [54]. Given a system X of the form (3.1), a vector € defines a 
generalized state of X if there exists an integer k and functions ¢ and w such 


that 
E = (x,u, ù... ,u(9)) 
x rs v(£, u, ü, EOS u) 


and, at least locally, 
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€ =. (Hl, u, Ù, die ul), u, à, dis ue 
t= v(o(z, u, ü, RAN u), u, ù, M u) 


Quite naturally, the notion of generalized state leads to that of generalized 
state-space transformation that can be formalized as follows. 
Definition 6.1. Let the system (3.1) be given. Then, a map 


T : (z,u,à,...,u(9,...) — (£,u,à,...,u9,...) 


is called a generalized state-space transformation if and only if dim Ẹ = dim x 
and there exists an integer k for which the following relations hold 


span(d£) C span(dz, du, dà, ... du? 
span{da} C span(d£, du, dà, ... , du? ) 
It follows from the above definition that, denoting by ¥ = span{dz} and 


U = span{du,du,...,du),...}, a generalized state-space transformation T 
gives rise to an isomorphism 7 : E = X GU — E = X SU such that 


i) (X) ÞU x £ GU 
ii) T(&) is a closed subspace of £. 


In particular, this means that there exist n elements £1, &,...,& € K such 
that 7(¥V) = span(d£i, d£», ..., d&,] and that 


O(&1, E2, Us ;£n)/O (21; T2, Pius ; Vn) 
is generically nonsingular. 
Example 6.2. Consider again the unicycle in Example 3.20. The relation 


& = 
£2 = £2 (6.1) 
&3 = (sin z3)ui 


defines a generalized state-space transformation £ = ó(x,u) in the sense of 


Definition 6.1, whose inverse x = v(£, u) is given by 


ry =£ 
Y : T2 = E2 (6.2) 


z3 = arcsin (£s /u1) 


6.2 Regular Generalized State Feedback 


In this section, our aim is the generalization of the notion of unimodular 
dynamic feedbacks to our framework. This is done by introducing the notion 
of regular generalized state feedback, that appeared for the first time in [132]. 


6.2 Regular Generalized State Feedback 91 


Letting, as usual, x and u be, respectively, the state and the output of a given 
system X of the form (3.1) and letting v be a new input, we can consider an 
input transformation of the form 


u = q(z,v,0,... ,v()) 
for which there exists an inverse transformation of the form 
v — y(z,u, à... ,u()) 
such that 
u — p(z, y... p) 
U = (a, P, $, Tm ,qO) 
'This leads us to state the following definition. 
Definition 6.3. A map 


F':(2,u,0,...,u(9,...) 2 (a,v,0,...,0,...) 


is called a regular generalized state feedback if and only if dim u = dim v and 
there exists an integer k for which the following relations hold: 

span(dv) C span(dz, du, dà, .. . ,du(?) 

span{du} C span(dz, dv, do, ... , dv?) 
Definition 6.3 implies that the input transformation considered is invertible. 
'Therefore, regular generalized state feedbacks form a group of feedback trans- 
formations. It may be useful to note that regular generalized state feedbacks 
in the sense of Definition 6.3 are a special case of quasi-static state feedbacks 
as defined in [30, 32]. 
Denoting by 4 = span{dx} and by U = span(du, dà, .. . , du(?,...), a regular 
generalized state feedback gives rise to an isomorphism 


o:E=XQU—E=XQU 


such that 


i) X@oU)~XOU 
ii) a(U) is a closed subspace of £. 


This implies, in particular, that 
O(v1, V2, ..., Uu )/O(u1, U2,..., Um) 


is generically nonsingular. 
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Example 6.4. An input transformation of the form 


s Be (6.3) 


uo = Vg + 04 


defines a regular generalized state feedback, or a quasi-static feedback, whose 


inverse is 
Uy = U1 
vz = Ug — l4 


Remark 6.5. Note that a relation of the form 
u = Ù 


does not define a regular generalized state feedback in the sense of Defini- 
tion 6.3, since condition span{dv} C span(dz,du, dà, ..., du?) does not 
hold or, in other terms, it is not possible to express v as a function of 
z,u,ü,...,u(9,.... 


6.3 Generalized Output Injection 


Concerning output injection, our aim, in this section, is to define a no- 
tion that generalizes to our framework the classic concept. Output injection 
is used to define the dynamics of observers, obtained by injecting the output 
of the system, whose state has to be reconstructed, into an auxiliary system, 
whose dynamics reproduces those of the observed system. In a more abstract 
and conceptual way, output injection is instrumental in constructing canon- 
ical forms, as in the construction of the already mentioned Morse canonical 
form. 

Here, we are more interested in the latter situation, and, therefore, we start by 
considering, as possible candidates for a suitable notion of generalized input in- 
jection, additive assignments of the form ¢ + #+ f(y,...,y%)), which involve 
nonlinear functions of y and of its derivatives. Actually, the transformations of 
this class may have undesired properties, since they could give rise to systems 
with different observability properties with respect to the original ones. The 
introduction of some restrictive conditions is therefore required. However, we 
will not undertake now the task of developing an appropriate general notion 
of output injection in this direction. To carry on a construction similar to that 
of the Morse canonical form, we do not need to consider the whole class of 
transformations induced by assignments of the form described above. It will 
be sufficient to use only very particular output injections of the above kind 
for obtaining a formal decomposition of a given system as described below 
(compare with [132]). So, for the moment, letting x and y be, respectively, 
the state and the output of a given system X of the form (3.1), we give only 
a temporary and very general definition that will be made more consistent in 
the following. 
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Definition 6.6. A formal assignment of the form 


i i+ fly,...,y), (6.4) 


is called an additive, universal output injection. 


A deeper discussion about the generalization of the notion of output injection 
will be the object of Section 6.5. 


6.4 Canonical Form 


Exploiting the notions introduced in the previous sections, we can now state 
and prove the following result about the existence of a canonical form for 
systems of the form (3.1). 


Theorem 6.7. ([132, 134]) Given a system X of the form 


_ J è= f(x) + g(x)u 
X= » = a) (6.5) 


where the components of f(.), g(.) and h(.) are meromorphic functions of 
x on an open subset D C IR" such that generically rankg(x) = m and 


rank Oh(z) — p, there exist a generalized state-space transformation, a regu- 
lar generalized state feedback, and a universal, additive output injection that 
formally transform the system into the following form: 


6 = AÇ + Bv 
a m é= f(¢, 6,0)... V9) (6.6) 
y = CÇ 


Remark 6.8. We point out that the transformation from X to X" is a formal 
operation that cannot be physically implemented, as the output cannot be 
injected into a given dynamic structure through its input and output channels. 


Remark 6.9. Note that X” is linear from an input-output point of view and 
that the new input v is obtained in terms of x,u, and of a finite number of 
derivatives of u. 


Proof (Proof of Theorem 6.7.). The proof of the statement is constructive and 
goes as follows. We start by constructing a suitable set of variables (C, v) by 
following procedure: 


Step 0 define Qo :— y 
Step k choose a subset of (Ck, vx) of the components of Çk—ı such that 
i) (dz, dui, ... du) dus, oe def 9. o, du) 
is a basis for span(dz, dj, ..., dy? ; 
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ii) (dco, dc; dui, ..., dv (^, 


span(dy, dg, . .. , dy? V. 


...,d¢,, dug} is a basis for 


The procedure stops when (Ck+1, v4.1) is empty, i.e.,when 


e (dz, du,,..., dv P dvo, ... , du, dup, diz} is a basis for 
span{dz, dj, ..., dy? ,dy*t)}, and 

© (dé, dCi, du, ..., dv, ... d, dup, diz} is a basis for 
span{dy,dy,...,dy@t)}. 


The structure algorithm provides a practical way of implementing the proce- 
dure described. 
At Step 1, start by writing 


; ylz, u) 
Co = ġ = (Oh/Ox) (f(x) + g(z)u) = | yı2(z,u) 
yız(z, u) 
where 


e Oyii(z, u)/Ou has a full row rank and 
rank Oyii(z, u)/Ou = rank 0g/0u 
e Oly, y12)/0x = has a full row rank and 
rank O(y, y12)/0x = rank O(y, yi2, y13) /0x 
'Then, define 


Ui = y1 (x, u) 


C1 := yi2(z, u) 


— — 
OOo å N 
M Nu 


It is easy to check that (61, v1) verify conditions i), ii) above. 
At Step k, after reordering if necessary, write 


p Yri(@,U,..-, u(*-V) 
Gk-i-— Y(k—1)2(2, Uy... ,u*-2) = Ly (z,u,..., u(*-D) 
Uks (t, u, ..., ulk-1)) 


where 


e Oyi1/Ou has a full row rank and 
rank O(yii, - - -, Y(k—1)1; Ye) /Ou = rank O(yi1,---,Y(R—1)15 9(k—1)2)/0u 
e Oyi»/Ox has a full row rank and 


rank O(y, yi2, . .. , yk2)/Ox = rank (y, yis, ..., Yk2, YR3)/Ox 
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'Then, define 


Uk :— Yk1 (x, uy... ,u&- D) (6.9) 
Ck :— yka (v, u,..., u79) (6.10) 


It is easy to check that (Cx, vi) verify conditions i), ii) above. 
Assume that the procedure stops at Step v. Then, if the set of variables 


Co = y(x) 
Qı = yı2(x, u) 

: (6.11) 
Gy E yv (v, disci u (71) 


contains less then n elements, it can be completed by adding block variables 


Gut = G2) (6.12) 


so that equations (6.11) and (6.12) together define a generalized state-space 
transformation 


T : (a, u,t,... uD) — (€,u,t,..., u("- 0) (6.13) 
Moreover, if the set of equations 


Ui = yii(z,u) 
(6.14) 


vy = yn (z, u,...,u- 9) 
contains less then m elements, it can be completed by adding block variables 
Uy41 = Uy+1(u) (6.15) 


so that equations (6.14) and (6.15) together define a diffeomorphism, linear in 
u, on some open subset of IR™+™”)), By solving for u, one obtains a regular 
generalized state feedback described locally by 


u= o(x, v, ... v" 79) (6.16) 
that satisfies the conditions 


span(dv) C span(dz, du, dà, .. . , du"? ) 
span{du} C span(dz, dv, dù.. . , dy ("7D 
To display the effect of both transformations (6.13) and (6.16) on the original 


system, let us note that, when the procedure stops after v steps (that is, 
when y(v+1)1 and y(,.,,17? are empty), one has a partition of the vector Ço, or 
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equivalently of y, into, say, p blocks and the rank of Oii (2, u), ho yi Gr, u)) 
is, say, p. Then, expressing the system in the new variables, 


Con = G1h 


Canh = Un 
Yh =Gon for 1E h € p 


E'—-4k = Cie 


Gas = Joris) 
Yk =Cor for p+l<k<p 


Coil = fC», t ,v?) 


Now, recalling how the variables 6o, ..., C, have been defined in (6.8), (6.10), 
the relations 


Gis = fr(Go1, tty Cni) 


can easily be modified by the additive, universal output injection defined by 
Cui => ear a fiy?) 
with 1 X ? € p, 0 € j € ny and p4- 1 € k< p. In this way, 


Con m Cih 


Canh = Uh 
Yr =Gon for 1 C h E p 


D" = Coe Ge (6.17) 


Yk = Gor for p+1<k<p 


Gut — fv, t v?) 


that, denoting (¢o,..-,¢np,p) by Ç and denoting ¢p41 by C, finally gives the 
desired form 


6 = AÇ + Bv 
6 = f(Q Cv, ... 0) 
y = CÇ 


6.4 Canonical Form 97 


Note that in representation (6.17), the subsystems described by the first two 
blocks of (6.17) that represent the observable part of X" are invariant with re- 
spect to generalized state-space transformations and regular generalized state 
feedbacks. 
The first one contains information on the algebraic structure at infinity of 
X, which corresponds to that contained in the list 7; of the Morse canonical 
form for linear systems. For each h, 1 € h < p, the list of orders of zeros at 
infinity is (n4 + 1,...,ng + 1). 

The list (ng41 + 1,..., ny +1} obtained by the second block coincides, if 
X is linear, with the Morse list 73. 





'To decompose the last block, as can be done in the linear case, we should 
now specialize and make further use of output injection. Although the gener- 
alization of the notion of feedback we employed came in quite a natural way, 
the situation is much more involved if we want to define a generalized notion 
of output injection. We will come back on this point after discussing some 
examples. 


6.4.1 Example 
The following system has been considered in [85] : 


Ly = u1 

t2 = £4 + ug 
t3 = £3U1 + Ug 
T4 = us 
Yı = Tı 

Y2 = T2 — T3 


Applying the procedure described in Section 6.4, we obtain, at the various 
steps: 


Co1 = T1 
Step 0 
PU Cog = £2 — za 


. UL vı :— uj 

Stepl y= 
SUCH " 85 in Cia :— X4 — T3U1 
uy 


: 2 V2 :— U3 — £3U1 — r3uy — u2ui 
ua — L3U1 — $3uj — U2U1 


Step 2 y= ( 
The procedure stops, giving 


C01 = Tı 

Coz = X2 — $3 

612 = q4 — T3U1 

YU = U1 

V2 = U3 — 231 v 232 — u2u1 
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By choosing, for instance, ¢3 :— x4 and v3 :— ug, we obtain a generalized 
state-space transformation and a regular generalized feedback such that the 
system X takes the form 
Coi = U1 
Go2 = C12 
y= C12 = v2 
G3 = Us 
y = Çor 
y2 = Go2 


6.4.2 Example 
Let us consider the following system : 


tı = u 
t2 = %4 u» 
t3 = u2 
t4 = 13 + u» 
Y= Tı 
Y2 = T2 — T3 





The system can be decoupled by a regular static state feedback. Then, the 
transformation we get by applying the procedure described in Section 6.4 
reduces to a usual state-space transformation and a regular state feedback. 
At the various steps, we obtain 


Step 0 Cor = 21 
C02 = X2 — Z3 
Step 1 ğı = u1 = y1 (z, u) = v4 
Y2 = T4 = y(x, u) = Cra 
Step 2 ğı = ù 
Y2 = T3 + u» = V2 
The procedure stops, and we can complete the transformation by defining 
C3 := T3. 
The system X now takes the form 


C01 meee ca | 

G02 = 2 
ye G2 = v2 

G3 = v2—¢3 

yı = Cor 


y2 = Go2 
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6.5 Generalizing the Notion of Output Injection 


To obtain a complete analogy with the Morse canonical form in the non- 
linear setting we are working in, we will now decouple (5,4 in (6.17) from 
(Go1,..., Cn,p) and (vi,..., v5), and then, possibly, we will split the corre- 
sponding block into a controllable part and a noncontrollable part. In decou- 
pling, we will use only transformations that may be viewed as generalizations 
of the notion of output injection, followed, possibly, by changes in coordinates. 
In the nonlinear framework, linear output injections have been used in [83], 
and an additive nonlinear output injection, similar to the one used above, 
has been employed in [104] for linearizing a nonlinear system, as well as in 
(71, 72] for transforming a nonlinear system into a bilinear one. In general, 
however, the problem of defining quite a general notion of output injection in 
a nonlinear framework has not received much attention in the literature. 
Here, we consider a class of output injections that are not necessarily additive 
and whose definition is consistent with that of regular generalized state feed- 
back formalized above and with that of quasi-static state feedback described 
in [32]. 

The basic idea consists of considering transformations that modify the dy- 
namics of a system X of the form (3.1) by an assignment of the form 


t — (£y, d... a 0) (6.18) 
In other terms, this amounts to transforming the system 


fer (27 fgg sen 


y = h(x) 
int 
i z- [27 fU steh af isi 
y — h(x). f 


In the following, to distinguish between the derivatives of y along the trajec- 
tories of X and those along the trajectories of X’, we will denote the latter 
ones by y!*], whereas y? will denote, as usual, the first ones. 

Clearly, some restrictions must limit the choice of the function 
O(f(x) + g(x)u,y, d, ..., y?) to avoid pathological situations. In particular, 
we want to prevent the possibility, for an output injection, of changing the 
observability properties in going from X to X”. Let us illustrate this point by 
the following example. 


Example 6.10. Let us consider the system 


rz, =0 
i= ¢ tg =0 
y = T1172 


which obviously is not fully observable, and let us apply the additive, universal 
output injection defined by 0(d, y) = (tı + y, 0)*. The resulting system is 
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tı = X172 
yo’ =< go =0 
y = TıT2 


which turns out to be completely observable (in the sense of [45]), since zı = 
y?/y and ay = yl /y. 


To go further, it is useful to recall the notion of observable space OM (LIT of 
a system X, defined in Chapter 4 as Os; = A N (y +U). Then, given an 
assignment of the form (6.18), let us denote by Hp and Hy, the vector spaces 
defined as follows. 


Hy = span{dy,dy,...,dy, du, dà, ...) 
Hy = span(dy, dull, ...,dy!*!, du, dà, ...] 


With the above tools, we can now define the notion of output injection, as in 
[122]. 


Definition 6.11. An assignment 3 — 0(3,y,3,..., y), for some integer 
r, is called a generalized output injection if the following conditions hold: 


e Hic Hii 
e Hy C Agyr-1 
abli, y, 9, ..., y?) 
Ox 
The following Proposition, proved in [122], states that generalized output 
injections behave well with respect to the property of observability. 





is generically invertible. 


Proposition 6.12. Given a system X of the form (3.1) and a generalized 
output injection 3 —> 0(3,y,W...- y), let Os, denote the observability 
space of X and let Ox = ¥ N (Y +U), where Y = span{dy!*), k > 0}, denote 
the observability space of the system X', obtained by applying formally to X 
the output injection defined by 0. Then, O% = On. 


Let us now go back to the system X” described by (6.17) at the end of Sec- 
tion 6.4. Denoting the block variables (Gon, ..., 5,5) for 0 € h € p, that is, the 
variables of the first block in (6.17), by ¢1, the block variables (Con, .-, Cn, n) 
for p -- 1 € h € p, that is, the variables of the second block in (6.17), by ¢2 
and the block variable ¢,41 by 63 and analogously denoting the block variables 
(v1,...,Ug) by wi and the vector consisting of then remaining inputs by we, 
we can rewrite (6.17) as 


à = fil, wi) 


G2 = fa(G2) 
G3 c fl, Co, Ca, wi,..., wi”), wa) 
y = h(i, C2) 


Let us focus on the subsystem 
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Ġ = fa(Cr, C2, Gw.. wP, wa)) (6.20) 


corresponding to the unobservable variable ¢3. The problem of decoupling Çs 
from G1, ¢2, and wu, by an output injection does not seem to be tractable in 
general. So, we limit our attention to the situations in which the function fs 
has particular properties. We assume that, for each component fsi of fs, there 
exists a function x;(63, w2) such that 


fsi = Fia w2), Gn ose wt?) 


In other terms, we assume that there exists a separation function of the ob- 
servable variables and the unobservable ones. 

Then, we have the following two cases: either fs; does not depend on ¢3 and 
on We, and we chose y;(¢3, w2) = 0, or (OF;/Ox;) 4 0. 

By the construction carried on in the proof of Proposition 6.12, 61, C2, and 
wP can be expressed in terms of y and its derivatives. Hence, we can define, 
in the case in which fs; does not depend on ¢3 and on vs, 


0i (Gai. Y, Y, $us ,yO) = Gsi EN Fi(G, 62, W1, as wi”) 
In the case in which 0F;/0x; # 0, we can apply the implicit function theorem 
to get 
= Gi( fai. G, Ca, W1, +++, wl”) 
and we define 


Oilin y d. --- yO) = Gi (Cais C1, Co, wi,- wh) 


The map 0 = (0),...,0;,...) defines a generalized output injection according 
to definition 6.11 which transforms (6.20) into 
G3 = Xs w2) 


where x = (x1,..., Xi; -.-). The desired decoupling has been achieved, yielding 
a maximal loss of accessibility. 

Obviously, the separability condition seen above is sufficient only to assure 
the possibility of decoupling ¢3 by an output injection. In addition, the fact 
that such a condition is not feedback invariant, as pointed out in [139], shows 
that complete characterization of the existence of an output injection with 
the desired property is still far from being obtained. 


Example 6.13. Let us consider the following system : 


A=- otho unt 
X= Q = = v2 (6.21) 


y =Q 
For the right-hand side of (6.21), we can write 
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Ge GtG-ut+ = F(x(G, 01), C) 
Blu 





OF 
where x = G2 - vi, F = x62 + (2 and — = (3. We obtain x = 





av G . Now, 
let us apply the generalized output injection (61, y) = & y y and transform 
X into the form ; 
a= tu 
G2 = v2 
y = 


where 61 is decoupled from the observable variable C2. 


Example 6.14. Let us consider, now, a case in which the nonobservable block 
cannot be split. To this aim, we take the system 


e = tu 
252 C2 = v2 (6.22) 
y =Q 
Assume that the right-hand side fı of (6.22) can be written as fi = 
F(x(G1,v1), 2) and compute the partial derivatives: 


; o OF 0 
tae a A nh 


d) (58) Sia (3) 
OG \00) "^ a ax dG 

TEA (58) z2. (=x) Si 
OO \ 0C2 OG1 V Ox Oa 


ð (0 
Now, between ii) and iii) there is a contradiction, since — of must be 
OC Oz 
o (Of, . 2 ; 
equal to dG IG . In this case, there does not exist a function F that can 
1 2 


separate the observable variables from the unobservable ones, and, therefore, 
the system X cannot be further decomposed by an output injection. 


Problem 


6.1. Consider the unicycle described by 


Ly = COS T3 U1 
£2 = sin T3 U1 


t3 = U2 
Yı = Tı 
Y2 = T2 


Compute the generalized transformations that yield the canonical form (6.6). 


Part II 


Applications to Control Problems 


7 


Input-output Linearization 


In practical control problems, nonlinear relations between variables are in gen- 
eral not easy to handle in a direct way. For this reason, a basic control strategy 
consists, first of all, of modifying the system structure by suitable feedbacks, 
so as to substitute nonlinear relations with linear ones. In this spirit, we start 
by considering the problem of compensating a given nonlinear system, to get 
a new system which defines a linear relation between input variables and out- 
put variables. 

This problem is called the input/output linearization problem and, if we re- 
strict our attention to regular static state feedbacks, it is formally described 
as follows. 


7.1 Input-output Linearization Problem Statement 


Given the system 
E = f(z) + g(a)u 
y = h(x) 
where the state x € JR”, the input u € IR", the output y € IRP, and the 
entries of f, g, h are meromorphic functions, find, if possible, a regular static 
state feedback u = a(x) + B(x)v and a state transformation £ = (x) such 
that, in the new variables, the compensated system is given by 


& = A161 + Biv 
£2 = fa(&£1, E2) + ga(&1, €2)v (7.1) 
Y= Ci6i 


with the pair (Ai, B1) controllable and the pair (C1, A1) observable. 
'The solution of the above problem is investigated first in the simpler single- 
output case and, then, in the multioutput case. 
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7.2 Single-output Case 


The single-output case of the input/output linearization problem concerns the 
most basic and elementary scheme in nonlinear control theory, and its solution 
is instrumental in designing classical nonlinear control architecture. The idea 
of the solution consists of canceling, by feedback, the nonlinear terms which 
appear in the rth time derivative y(t) of the output, r being the relative 
degree of y(t) . 
In robotics, this control strategy is largely applied, for instance, in so-called 
computed torque control schemes (see, for instance, [147]). 

An easy necessary and sufficient condition for the solvability of the problem 
can be stated in the following way: 


Theorem 7.1. Assume p = 1; then the static state feedback input-output lin- 
earization problem for X is solvable if and only if its relative degree is finite. 


Proof. Sufficiency: Let r be the relative degree of the output and let hi(x):— 
g(z),..., hr-1(£) :9 y P (x) and vı := y(? (x,u). One proves by contradic- 
tion that 

ank 2G); ha (2); s Ap—1(2)) ve" (7.2) 

Ox 

Assume that (7.2) is not satisfied, then without loss of generality, assume 
that dh,_1 € spanc(dh, dhi,...,dh, 3]. From the implicit function theo- 
rem, there locally exists * such that h-_1(x) = y(h(x), hi(a),..., hr—2(x)). 
The latter yields dy? € span, {dh, dha, ... , dh,..3) for any k > 0. 
Let (£1,...,6i,) = (h(x),hi(x),....h, 1(x)) which can be completed to 
define a state bc. Seas D a similar vein, v5 can be completed by 
Ó U1,..., Um 


(v2, ..., Um) so that is invertible. The result follows. 
Necessity: Any controllable and observable linear system has a finite relative 
degree. L| 
Example 7.2. Let 
Yi = 2 
d5 =U 
y=) 


Follow the above procedure and define £43 = xg, 619 = qi and v = 2rsu. Note 
that the transformation £(r)is meromorphic, whereas the inverse transforma- 
tion £^! is not. The linearizing state feedback is u = v/2z5, and the linear 
closed loop system has transfer function 1/s?. 


7.3 Multioutput Case 


'The above elementary solution can be easily generalized to multioutput sys- 
tems. The resulting condition becomes a sufficient condition. 
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Theorem 7.3. The input-output linearization problem for X is solvable if 


(ri) , (r2) 


(rp) 
tunc [+--+] =p (7.3) 
Ou 


where r; denotes the relative degree of the output function hj, for i =1,...,p. 


Proof. Set v; = ys" (x,u) for i = 1,...,p and choose, on the basis of (7.3, 


i 


Up+1;:--; Um), 80 that Ov/Ou is invertible. The result follows. | 


AY? y ,..., 


(rp) 
The matrix | m | appearing in condition (7.3) is usually called 


the decoupling matrix of X. 
Condition (7.3) is clearly not necessary. This is seen, e.g., in the following 
example. 


Example 7.4. For the linear system 


Ti = ui 
£6 = £3 + u1 
J= i3 = U2 (7.4) 
Y= X1 
y2 = v2 


an easy computation shows that rank Ge = 


A necessary and sufficient condition for input-output linearization is found in 
[90] and it can be stated as follows: 


Theorem 7.5. Assume that the system (1.1) is right invertible. Then, the 
input-output linearization problem is solvable if and only if 


OG, sees) aly, y™) | 


O(u, à, ... Al mu las lynn Lui 1] G 


ranky 


Proof. Necessity: Condition (7.5) is clearly satisfied for the closed-loop system. 
From the chain rule, it is also invariant under invertible static state feedback. 
Sufficiency: Let us rewrite the Structure Algorithm 5.7 in the special situation 
where condition (7.5) is fulfilled. 


Step 1 
Compute , . 
an *(&) 
ji ài(x) + by (x)u A 
From condition (7.5), the rows of bi (x) are linearly dependent, over IR, upon 
the rows of bı (x), thus 
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À = a(x) = Liài(a) + Lži 


for some real valued matrix Lı. Denote z2 := 21 — £121 := Go(z). 


Step 2 
= (Ce Oa) 





Compute 





à = G7(x) — Ls (23) EN G 


for some real valued matrix Lo. Denote z3 := Bo — La (2 ) 
2 


a (BE +h) (8) 
Gz (x) em by (x)u Zk 
From (7.5), the rows of b, (a) are linearly dependent, over IR, upon the rows 


bi (x) 
of : , thus 


Step k 
Compute 








Gp—1(2) Zp-1(2) 


for some real valued matrix Lg. Denote 


21 
Zk+1 = Êk — Lk 


Ey 1(x) 


From the right-invertibility assumption, there exists N € JN such that 
bi (x) 
rank : = p. A regular static state feedback, which solves the problem, 


bw (2) 
is then defined by solving in u the set of p equations 
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Example 7.6. Let us consider the system X described by the following equa- 
tions: 


Ly = TZU 

i» = gi F 2x3u1 

dg ds (7.6) 
T4 = U2 

Yı = Tı 

y2 = To 


From step 1 of the structure algorithm, set vı := £3uı and jo = x4 + 24. 
Differentiate x4 instead of jo and set v9 :— ug. Consequently, the linearizing 
static state feedback is computed as u1 = v1/xa and u4 = Vo. 


Remark 7.7. Note that, beside being useful for technical reasons, the hypoth- 
esis of right invertibility in Theorem 7.5 is crucial for avoiding cases which 
are, in some sense, pathological. A simple example, just to understand what 
kind of pathology may arise, is provided by the system AX described by the 
following equations 


iiu 

d» = sj (7.7) 
yi = Ti 

y2 = T2 


Clearly, X gives rise to a linear input/output relation characterized by the 
transfer function matrix G(s) = [1/s 0], but, due to the presence of the 
uncontrolled output y2(t), it cannot be brought into the form (7.1). On the 
other hand, and for the same reason, X is not right invertible. 


7.4 Trajectory Tracking 


As an application of the linearization technique described above, let us con- 
sider the problem of tracking a given reference, or reference trajectory tracking 
problem. 

In general, such a problem can be stated as follows. 


7.4.1 Trajectory Tracking Problem Statement 


Given a system X of the form (1.4) 
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__ fèt) = FH) + g(a(t)u(t) 
Hep h(a(t)) 


and a reference output trajectory ya(t), t > 0, find a dynamic output feedback 
Xr such that the output y(t) of the closed-loop system driven by y; tracks 
ya(t) asymptotically. In other words, this means that the error 


e(t) = ya(t) — y(t) 


goes asymptotically to 0 as t goes to infinity. 
The goal of this chapter is twofold: 


e to derive a feedback control law by using input-output linearization tech- 
niques and 

e to analyze the internal stability of the compensated system so obtained in 
relation to the zero dynamics of the original system, as in Section 5.6. 


7.4.2 Reference Trajectory Tracking: an Introductory Example 


Let X be 
ij-—rz2-u 
y = Tı 


and consider the reference trajectory yalt) = sint. Compute e = sint — x 
and 
ė = cost — T2 — u 


Pick A > 0 and solve the equation in u: 





cost — zo — u = —A(sint — 21) 
The feedback solution u = cost — z» + A(sint — z1) yields 
é——A-.e 


which means asymptotic tracking of the reference trajectory. 
In addition, the closed-loop dynamics reads 


tı = cost + A(sint — 21) 
t2 = —X2 + cost + A(sint — vg) 





The variable £2 is now unobservable from the output y = x1; however, it 
is stable. 
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7.4.3 Reference Trajectory Tracking Without Internal Stability 


Here, we will assume that X is a SISO and invertible system (i.e., its relative 
degree is finite). Let p be its relative degree. The law governing the evolution 
of e(t) can be chosen arbitrarily, as long as its asymptotic behavior agrees 
with the problem statement. Practically, one usually chooses 


ef) (t) = — Xi de (t) (7.9) 


where s? + Apis? | +- + As + Xo is a Hurwitz polynomial. 
Rewrite (7.9) as 


y? (s, u) = ya (t) + EL du O — 9 (@)] (7.10) 
The left-hand side of (7.10) is affine in u: 
y? (x,u) = a(x) + b(x)u 
Equation (7.10) can easily be solved in u as 


1 


= ga; C6) +d + EP NP) 9G) TW 


which solves the problem. 


7.4.4 A Second Example 


Let X be 
t= 2c u 
19 = —u 
y = Tı 


and consider again the reference trajectory ya(t) = sint. 
Compute e = sint — xı and 


È = cost — t2 — U 


Pick A > 0 and solve the equation in u: 





cost — r9 — u = —A(sint — z1) 
The feedback solution u = cost — z» + A(sint — z1) yields 
é——A-.e 
which means asymptotic tracking of the reference trajectory, as in Example 


(7.8). 
'The associated error system thus reads 
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tı = tə +u 
to = —u (7.12) 


e = sint — z1 
Compute the inverse of (7.12) 


2, = + cost 
Z9 = —€+ 22 — cost (7.13) 
u = È — z2 + cost 


and the zero dynamics of (7.12) is thus 
ż =z — cost 


The conclusion is that the above standard computation yields asymptotic 
trajectory tracking; however, the unobservable variable z is unstable. The 
constraint of internal stability is investigated next. 


7.4.5 Reference Trajectory Tracking With Internal Stability 


As an application of the notion of zero dynamics introduced in Section 5.6 
combined with the input-output linearization technique, we can introduce the 
solution of tracking with internal stability. 

Assume that X is a SISO, invertible, and minimal system. The law gov- 
erning the evolution of e(t) can be chosen arbitrarily, as long as its asymptotic 
behavior agrees with the problem statement. In general, one can take 


q(e(£), e(t)™, ...,e(t)) 2 0 (7.14) 


provided q is meromorphic and such that any solution e(t) of (7.14) goes 
asymptotically to 0 as t goes to infinity. 

Practically, one usually chooses to solve (7.9) in u and obtain the feedback 
solution (7.11). 

Write the closed-loop system in the following special coordinates: 


44 = h(a) 

z2 = (x) 

Zp = aea) 
zolz) 


where zo(z) is any (n — p)-dimensional completion so that 


O(z1, Z2, ..., Zp} Z0 
pau onic PO) DTE bs 


Ox 
Thus, the closed-loop system has the form 
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A = 22 

29 = 23 
(7.15) 
Zp-1 = 2p 


Sp = ya (t) + SHEP A y E) — za (2)] 
Žo >= fo(z, ya P (t), e) ya(t)) 


The variable zp is unobservable from the output y = z1. The zo-dynamics is the 
zero dynamics as introduced in Section 5.6, driven by the signal yq(t). Thus, 
trajectory tracking is solvable with internal stability whenever the relative 
degree of the output is finite and the zero dynamics of the system is stable. 


Problems 


7.1. Consider the unicycle in Example 3.20 whose state equations are 
COS T3 U1 
t= | singz3 uy, 


U2 


with output 


Check condition (7.3) of Theorem 7.3. 


7.2. Apply to the unicycle the precompensator 


£4 = v1 
ui = X4 
Ug = V2 


and resume the computation of condition (7.3) of Theorem 7.3; the input 
consists now of the acceleration vı and the velocity v2; the output considered 
remains the same as in Exercise 7.1. 


8 


Noninteracting Control 


In Section 7.3, the feedback that solves the input-output linearization prob- 
lem also achieves noninteracting control, in the sense that for the closed-loop 
system, the output component y; is affected only by the input component 
vi, for i = 1,...,p. A similar decoupled form appears in the canonical form 
derived in Section 6.4. This is formalized and completed in this chapter. 

The noninteracting control problem is a fundamental control problem whose 
solution allows one to tackle multivariable control and design problems using 
SISO techniques. Further technological motivation for trying to achieve nonin- 
teraction is that human supervision of complex systems, like industrial plants, 
advanced vehicles, and so on, is greatly simplified if different components of 
the output behavior are controlled separately. 


8.1 Noninteracting Control Problem Statement 


Given the system 


y = h(x) 


where the state x € IR", the input u € IR”, the output y € IR?, and the entries 
of f, g, h are meromorphic functions, find, if possible, a regular dynamic 


S (8.1) 





compensator 
z= F(z,z)-4 G(a,z)v 
pueda me B(x, z)v (8:2) 
where z € JR? for some integer q such that, for every i = 1,...,m 
i) 
a, ! (k) 
y; € spanç{dzr,dz,dv;,..., du” },k > 0 (8.3) 


ii) 
dy? ¢ spany (dz, dz] for some k € IN (8.4) 
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Condition (8.3) represents the noninteraction constraint, and condition 
(8.4) ensures output controllability in the closed-loop system. 


8.2 Static State Feedback Solution 


A particular class of solutions of the above problem is that consisting of static 
state feedbacks, of compensators of the form (8.2) with dim z = 0. Existence 
of solutions of that kind is characterized in the next theorem. 


Theorem 8.1. The noninteracting control problem is solvable via a regular 
static state feedback of the form u(t) = a(a(t)) + B(x(t)) if and only if the 
following two equivalent conditions are satisfied 
e 

1 ’ Y2 2110 9p 

Ou 
e the relative degrees of the p scalar output functions are all finite, and the 
list of relative degrees equals the list of orders of zeros at infinity. 


aly» (r2) , ys?) 


rank =p 


Proof. The sufficiency follows from the proof of Theorem 7.3. For the necessity, 
note that (8.4) implies that all the relative degrees are finite and condition 
(ri) 

[| 


i . 


(8.3) yields the independence of the inputs in y 


8.3 Dynamic State Feedback Solution 


A general solution to the above problem, consisting of a dynamic compensator, 
is characterized by the following theorem. 


Theorem 8.2. The noninteracting control problem is solvable via a regular 
dynamic compensator of the form (8.2) if and only if the system X is right- 
invertible. 


Proof. Necessity is obvious, and sufficiency may be proved by deriving a stan- 
dard dynamic compensator, a so-called Singh compensator, from the inversion 
algorithm. It yields y; = vj for any i = 1,...,p. 

These statements follow from the consideration of the inversion equations 
(5.9), where the derivatives of the output range from yn?) to ge If nie A ni, 
set 241 = y O9, E y UU. and solve the equations in u: 


(nie) 


Vi =U; 


whose solution is u = a(x, z) + B(x, z)v. 
Finally, the dynamic compensator, which solves the problem, reads 
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Zil = i2 


Zinn, = Vi, for i=1,...,p 
u = a(x, z) + B(x, z)v 


8.4 Noninteracting Control via Quasi-static State 
Feedback 


Problem Statement 


Given the system X (8.1), find, if possible, a quasi-static state feedback 
u=a(a,v,0,...) such that, for every à = 1,...,m, 
i) 
dy € spany (dz, dv;,... , dv), k > 0 (8.5) 
ii) 
dy!” g spany {de} (8.6) 
Recall that a quasi-static state feedback is invertible by Definition 6.3. 


Theorem 8.3. The noninteracting control problem is solvable via quasi-static 
state feedback if and only if the system is right-invertible. 


Proof. Necessity follows from condition (8.6); the decoupled system is nec- 
essarily right-invertible. The sufficiency follows from the construction of the 
canonical form (6.17). | 


Example 8.4. Consider the unicycle in Example 3.20 with the two outputs 
yi = zı and y2 = £2. The condition in Theorem 8.1 is not satisfied since 
rank O(y1, ¥2)/Ou = 1. The system is right-invertible, however, and it can 
be decoupled by a quasi-static state feedback. Such a solution is obtained 
following the procedure described in Section 6.4, derived from the inversion 
algorithm: 

ui = Z/ cos £3 


ug = cos? z3(v2 — v tan z3)/z 


The closed-loop system reduces to two decoupled linear systems, a first or- 
der system ğı = vı and a second order one jj = v2. A standard dynamic 
decoupling compensator is 


Žž =v 
ui = z/ cos £3 


9. U2 — v1 tan x3 
U2 = COS^ £3 ———————— 
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Quasi-static state feedbacks are viewed herein as a mathematical tool that 
describes standard decoupling dynamic compensators acting on extended state 
spaces. The main benefit in using quasi-static state feedbacks comes from the 
fact that they define a group of transformations, whereas the class of regular 
dynamic compensators does not. 


Problem 


8.1. Consider again the unicycle in Example 3.20 described by 


Ly = U1 COS T3 
t2 — u1 sin £3 


13 = Ug 
Y= Tı 
y2 = T2 


Compute the dynamic state feedback and a quasi-static state feedback that 
solve the noninteracting control problem. 
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Input-state Linearization 


The control strategy employed in dealing with the input-output lineariza- 
tion problem has the effect, when a solution to the problem exists, of fully 
linearizing the state-space equations of the original system if it is a single- 
output system with relative degree equal to n. More precisely, one obtains in 
that case a compensated system of the form (7.1) in which dim £1 = n and 
dim £9 = 0. The same holds true for a multioutput system whose decoupling 
matrix is square and invertible, i.e., condition (7.3) is satisfied and the sum 
of the relative degrees of the output functions equals n. 

The input/state linearization problem we consider in this chapter consists of 
searching for output functions that fulfill the above conditions. This issue is of 
major importance whenever the input-output linearization technique yields a 
closed-loop system that contains a possibly unstable unobservable subsystem. 
The presence of unstable internal dynamics disqualifies the input-output lin- 
earization scheme. The approach leading to the input-state linearization, on 
the other hand, allows one to master internal stability, although it may not 
produce a linear input-output relation. 

Formally, the problem is stated as follows. 


9.1 Input-state Linearization Problem Statement 


Given the system X, 

t = f(x) + g(x)u (9.1) 
where the state x € IR", the input u € IR", and the entries of f, g are 
meromorphic functions, find, if possible, a regular dynamic compensator 


u = a(x, €) + B(x, £)u 
where € € IR? for some integer q and a state transformation z = (x, €) where 


@ is a local diffeomorphism from IR"*? to IR"*? at almost any point of IR"*4, 
such that the closed-loop system reads 
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z= Áz + Bv 


where the pair (A, B) is controllable. 


9.2 Static State Feedback Solution 


Here, we first consider the input/state linearization problem by restricting 
the class of solutions considered to that of regular static state feedbacks, that 
is, compensators of the form (9.2) with q = 0. It is not restrictive in formu- 
lating the above problem to look for solutions that yield the pair (A, B) in 
Brunovsky canonical form. 

Solving the input-state linearization problem, then, consists of searching for 
the largest independent Brunovsky blocks, or for the largest independent 
strings of integrators, or equivalently for a set of some functions in K that 
have the largest relative degree and are controlled by independent inputs. 
These functions are candidates for playing the role of output functions in the 
input/output linearization problem. The input/state linearization problem is 
then solvable by regular static state feedback if and only if the sum of the 
associated relative degrees is n, the dimension of the state space. These ideas 
are formalized in the sequel. 


Theorem 9.1. There exists a static state feedback that solves the input-state 
linearization problem for X if and only if 


(i) Hæ — 0 and 
(ti) Hy is closed for any k > 1. 


Condition (i) is an accessibility condition which is obviously necessary since 
X has to be transformed into a linear controllable system. Condition (ii) is an 
integrability condition that implies that the controllability indices of X are 
the controllability indices of the resulting closed-loop linear system. 


Proof of Theorem 9.1. The conditions of Theorem 9.1 are clearly necessary. 
For sufficiency, let k* = maz(k > 0| £ 0}, s = dimHy», and (dq, ..., dys} 
be a basis for Hp». Suppose that 

k* k* 
Oe) gt) 
Ou 


Then there exist oj, i = 1,...,s which are not all zero and such that 


rank «s (9.3) 


s (k*) 
5 Qi OY = 0 


; Ou 
i=l 





Let w = 5 ,oj;do; and compute wk") which belongs to X. Thus, w is 
nonzero and belongs to Hyz«+1. From this contradiction, we conclude that 
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(k*) 
(9.3) does not hold and s = dim ^, 5. 


Since 7íy« 1 D Hes + Hr, denote 
Hy 
Hy» + um 


and let [dq1,..., do, dé1,..., da; dV, ..., dig) be a basis for 71i 1. 
Suppose that 


o := dim 


ay, sees eU, PES. ee) qc 


Ou 
Then there exist oj, i = 1,..., s and £j, j =1,...,0, where the (;’s are not all 
zero, such that 


rank <sto (9.4) 


s * c (k* —1) 
ay? Ov; 
2 “— Ou S De Bi ðu 9 
t=1 j=l 
Let w = 5; aidġi + pond f;dw;. Thus, w is nonzero and w) € x. 
It yields w € Hy». This stands in contradiction to the fact that the 8;'s are 
not all zero, and (9.4) does not hold. By induction, it is possible to write a 





basis for Hı = span, {dx} as {dp i =1,...,m,j = 0,...,r; — 1} where 
ri denotes the relative degree of y;. Input-output linearization of the out- 
puts (qi, i = 1,...,m} fully linearizes the state equation in the coordinates 


(o9, i2 1,... m, j 2 0,..., ri - 1). E 


9.2.1 Dynamic State Feedback Solution 


If static state feedback solutions do not exist, it becomes interesting to look 
for possible solutions in the class of dynamic state feedbacks. Once again, it 
is not restrictive in formulating the above problem to look for solutions that 
yield the pair (A, B) in Brunovsky canonical form. 

Solving the dynamic input-state linearization problem consists of searching 
for some functions in K that have the largest structure at infinity. These 
functions are candidates for the role of output functions in the input/output 
linearization problem. The input/state linearization problem is then solvable 
by regular dynamic state feedback if and only if the sum of the associated 
orders of zeros at infinity is equal to n, the dimension of the state space. 
Equivalently, these linearizing output functions define a system without zero 
dynamics, in the sense of Section 5.6. Following the ideas described in [89], we 
note that a solution of the problem considered may be derived by using the 
Hk spaces defined in Section 3.5. Since the closed-loop system has to be fully 
controllable, a necessary condition is Hoo = 0. Then a canonical basis for the 
Hpg’s can be constructed as follows. Let {w,«} be a basis of Hp»: 


Hy = spang {wp } 
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Let [wi*-1) be such that {wp*, Wk*, wk*—1} is a basis of Hp+_1: 
Hays = Spang {wk ues We } 
More generally, let (wi) be such that 
Hy = (Hy + He+1) @ spanc(wx] 


for k = 1,...,k*. A sufficient condition for the existence of general solutions 
of the input/state linearization problem is as follows. 


Theorem 9.2. If {w1,...,wx«} is integrable, then the dynamic state feedback 
linearization problem is solvable. 


Example 9.8. Consider the unicycle in Example 3.20. From the computation 


Hı = span, {dr} 
Hə = spang {(sin z3)dz, — (cos x3)dx2} 
H3 = 0 


k* = 2, w2 = (sin za)dzi — (cos z3)dza. 
Since w2 = u3coszadaz; + uzsin rgdzə — ujdza3, one may pick wi = daz, so 
that 

Hı = span {we, We, w1} 

H5 = span {w2} 


Finally, span, {we, w1 } is integrable and equals span, (dyi, dy2} where yı = 2i 
and yo = £2 is a set of linearizing outputs. 


Proof (Proof of Theorem 9.2.). Let {dy1,...,dyYm} be a basis for 
span (wi, ..., wx»). By construction, the sum of the orders of zeros at infinity 
of (w1,...,wi*) equals n. This sum cannot decrease by a change of basis, so 
it equals also the sum of the orders of zeros at infinity of {dy1, ...,dym}. Con- 
sequently, [(dyi,...,dy,,) defines a set of output functions without any zero 
dynamics, and it embodies a solution of the dynamic feedback linearization 
problem. [| 


9.3 Partial Linearization 


When the input-state linearization problem has no solution, it is interesting to 
investigate a more general problem, first stated and solved by Marino [112]. 

Actually, one may try to find the largest linearizable subsystem of a given 
system X. The closed-loop system obtained by linearizing such a subsystem 


will read 
A = A121 + Bv 


d c qub (2) (9.5) 
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where dim z;+dim z2 = n and dim vı +dim v = m. Necessarily, the dimension 
of the largest Brunovsky block of the pair (A1, B1) is less than or equal to k*. 
Let Hp denote the largest closed subspace contained in Hp. Consequently, a 
sequence 





HDHD- »5H»5-- 


is associated with the sequence {Hg}. By definition, Hı = Hı and Hk D Hg. 
By construction of the H;’s, the following also holds: 





Hi D Hepi t+ Ta 


and 











Hr D Arti + Heys 
This allows us to define E 
Hi, TX 
HY) +X 


nj :— dim 


and more generally, for k = 2, ...,m, 
Ho +x 


HS LX 


nj i= dim 


(9.6) 


First, consider the special case of single-input, accessible systems. 


Theorem 9.4. If m = 1, then the largest linearizable subsystem has dimen- 
sion s where 


s = max(k > 1| Hk 40} 


Since Hoo, s always exists and 1 € s € n. 


Proof. Let z1, be the first component of zı in (9.5). Denote ¢ := dim 2. 
Assume without loss of generality that (A1, B1) is in Brunovsky canonical 
form. Necessarily, dzi1 € He and He D Hs. This shows that in any partial 
linearization, ¢ < s. 

It now remains to show that there exists a solution that linearizes a sub- 
system of order s. Since m = 1, n, = 1 and n; = 0 for any i = l,..,n, i Æ s. 
Pick dzj1 € Hs, apply standard input-output linearization, and the result 
follows. E 


In the multiinput case, one defines similarly m dummy outputs that can be 
linearized and decoupled following the standard procedure. 


Theorem 9.5. Consider an accessible system; then, the largest linearizable 
subsystem has dimension 


my +2no+...+ SNs. 
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Proof. Pick dyii,...,dYijn, in Hı and more generally doy 1, ..., dgy, n, in Hn, 
for k = 2,..., s, such that 
pank l Pato rr Pam ri Ponds 7 Pha) so Pinar Po — Paine) =n Festns 

Ou 
Standard decoupling of these dummy outputs yields a linear subsystem that 
consists of n; blocks of dimension 1 and more generally of n; blocks of dimen- 
sion i, for i = 2, ..., s. It remains to show that any partial linearization has a 
lower dimension. Consider the partially linearized system (9.5), and assume 
without loss of generality that (Ai, B1) is in Brunovsky canonical form. Let 
pi denote the number of Brunovsky blocks of order i, for i > 1. Necessarily, 
pi = 0 for i > s and p, € ns. 
Investigation of further steps yields 


Ds T ps-i < Ns +Ns-1 


and more generally, 


nsnm 
i=k i=k 
for any k, 1 < k < s. This yields the claimed result. E 
Example 9.6. Consider 
X1 10 
T2 £3 0 
£4 T4 0 ui 
Weil (5) TR 
Dci Xn 0 
Tr 0 1 
'Then, compute 
Ho = spanç{z3dzı = dz», m Endz = d£n-1} 
and more generally, for 2 € k € n — 1, 
Hk = span(zadzi — dzo,..., 24 gdzi — dEn-k+1}, 


Hn =H =0 


Consequently, nı = 2, n; = 0 for any i > 2. The integrability conditions (ii) 
in Theorem 9.1 are not satisfied. Theorem 9.5 yields that the largest feedback 
linearizable subsystem has dimension 2 and consists of two one-dimensional 
subsystems. 

Note that system (9.7) is accessible and that any nonconstant function of the 
state has relative degree 1 only. 
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Theorem 9.1 is a special case of Theorem 9.5 and is equivalent to 


Corollary 9.7. System (9.1) can be fully linearized via static state feedback 
if and only if 


i—m 


i=1 
The integers n; may alternatively be computed as 


Corollary 9.8. Fork = 1,...,n 


ny = din e cas (9.8) 
Tai + Hest 


Proof. Choose bases of the following spaces as 
Haa = span{dpk+1} 
Hx = span{dyrs1, deii dux) 
= (Hep + Hai) 6 span(dvx) 
Thus, in (9.8), ng = dimspan(dv&). Now compute 


gz; 0) 


Hy, +X = span{dgy td deke ae dx} 


= span{dp\**) dut ) dx} 





and Gti) 
m +X = span(do(^*? , dx} 


Returning to Definition (9.6), ng = dim span (du f” }, and the result follows. 
E 


Example 9.9. Consider the unicycle in Example 3.20 with the slight modifica- 
tion in the inputs: let the velocity ui be a fourth state, and let the acceleration 
tà; be a new input, denoted vı. The angular velocity ug remains the second 
controlled input and is denoted v3. The system's description then becomes 


£4 COS £3 00 
se T4 sin £3 00 U1 
= 0 +| o1 el (9.9) 
0 10 


Compute, H2 = span (dzi, dz2}, Ha = 0, and 
HY? = span {d(v1 cos x3 — voz4 sin x3), d(v1 sin £3 + v324 cos x3) } 


System (9.9) is fully linearizable by regular static state feedback obtained by 
solving the following equations in v: 
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Ui COS Z3 — V274 SİN 33 = W1 


Ui SİN z3 + V2£4 COS 23 = W2 


which yield 
Vv, = W1 COS £3 + t» SİN £3 


U2 = (w2 cos £3 — w SİN £3)/£4. 


The linearizing state coordinates are zj = £1, 22 = £4 COS £3, £3 = Xo, and 
Z4 = x4sin z3. This solution is equivalently obtained when considering x; and 
x2 as outputs and applying the input-output linearization technique. 


Problem 
9.1. Consider the realization of the ball and beam example, obtained from 
Exercise 2.2. 


1. Check the full linearization of the system. 
2. Compute the largest linearizable subsystem. 


10 


Disturbance Decoupling 


The disturbance decoupling problem is basic in control theory, and its study 
has fostered the development of the so-called geometric approach in linear 
systems theory [160], [6] as well as in nonlinear systems theory [86, 126]. The 
solution of that problem by an invertible state feedback is well established by 
means of standard geometric tools in [86, 126] and it will not be considered 
here. We will instead concentrate on a more general situation, looking for a 
quasi-static state feedback that achieves decoupling of the disturbance from 
the output. 

The idea of the solution is that of using feedback to make the output inde- 
pendent from those state components whose evolution is influenced by the 
disturbance. In other words, this means to make unobservable a suitable sub- 
space of the state space in the compensated system. This strategy is clarified 
by the following simple example. 


Example 10.1. 

tı = to + Uu 

t2 = w (10.1) 

y= 2X1 
where u is the control and w the disturbance. Through x2, the disturbance w 
affects the output y: 

jy — wd ua. 
The invertible (static) state feedback u = —a2 + v renders x2 unobservable 
and decouples the disturbance w from the output y in the closed-loop system: 


y(9 2 97D, ko 1, 


The general solution of the problem achieves the same goal; it renders un- 
observable (under feedback) the largest subspace of the state space, and the 
disturbance is rejected from the output if the disturbance affects only the 
largest possible subspace. This scheme is displayed in Figure 10.1. 
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y 
Unobservable 
subsystem 
Fig. 10.1. Disturbance decoupled system 
10.1. Disturbance Decouling Problem 
Given the system 
= l t = f(a) + g(a)u + p(z)u T 
y = h(x) 


where the state x € IR", the input u € IR™, the output y € IR”, the distur- 
bance w € JR’, and the entries of f, g, p, h are meromorphic functions, find, 
if possible, a regular dynamic compensator 





5 = F(z,z)  G(z,z)vz € IC 


u = a(z,z) + B(x, z)v 


such that 
dy? € spany (dz, dz, dv, di, ...) for any i € IN (10.3) 


10.1 Solution of the Disturbance Decoupling Problem 


The solution of the above problem is related to the structure of the smallest 
subspace that is observable under transformations induced by regular dy- 
namic compensators. Recall from Chapter 4 that the observable space of sys- 
tem (10.2) with w = 0 is given by A n (Y + U). The subspace X N y of 
the observable space turns out to be the smallest observable subspace under 
transformations induced by regular dynamic compensators. It therefore gives 
the key for solving the disturbance decoupling problem, as described in the 
following theorem. 
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Theorem 10.2. The disturbance decoupling problem is solvable if and only if 
p(x) is orthogonal to the subspace XN Y. 


Before proving Theorem 10.2, let us give an illustrative example, taken from 
[80]. 
Example 10.3. Consider the system X described by the following equations 





11 = d32u1 

d = X5 

i3 = T2 + £4 + x4ui 

i4 = uz (10.4) 
£5 = 4d1uj-ruw 

y= Ti 

y2 — T3 


From the structure algorithm, one computes 
"m ; 
X NY = span, {dz1, dz3, (1 — T$ dra +(14+ Zdra} 
2 2 


0 
0 
Since p(x) = | 0 |, the condition in Theorem 10.2 is satisfied. Solving for u 
0 
1 
the equations 
yı =v 
x 10.5 
hos (10.5) 
one gets 
U1 = U1 i T2 
(10.6) 


uo = min (x — z5 + und — Hs) 
and one can construct the regular dynamic compensator 
Žž = w 
uy = z/ z2 
ug = zliz = (ws — 45d Ea — Zun ) 
Hence, in the compensated system, įjı (t) = vı (t) and j2(t) = v2(t) as desired. 


Proof (Proof of Theorem 10.2). Necessity follows from the fact that in the 
compensated system one wants to have p(x) L (¥ N y) and the space YN VY 
does not change under the action of the compensator. 

Conversely, if p(x) L (¥ N VY), the disturbance input w does not appear in 
the equations of the form (5.9) obtained by applying the Structure Algorithm 
to a system X of the form (10.2). As illustrated in the above example, this 
allows us to construct a regular dynamic compensator that guarantees (10.3). 
E 


11 
Model Matching 


In the nonlinear framework, the model matching problem was considered in 
[43] and, in the case of a linear model, in [39, 84]. Some further contributions 
are in [130]. The formulation of the model matching problem that we give in 
the following differs slightly from that of [43]. However, our approach provides 
a condition for the solution of the problem which is at the same time necessary 
and sufficient, whereas the conditions given in [43] are either necessary or 
sufficient. 


11.1 A Special Form of the Inversion Algorithm 


Given the system X, we may consider its input u as divided into two subsets 
u = (v, w), where v is viewed as a set of controls and w as a set of parameters. 
In this case, we apply the following algorithm to X. 


Algorithm 11.1 
Step 1. 
Calculate 
. Oh 
Y= gc f Gn) + ge(z)v  gu(z)w = file, w) + gi(a)o 


and set Gi(x) := gi(x) and sı :— rankGı (x). Permute, if necessary, the rows 
of the output so that the first sı rows of Gi1(x) are linearly independent, and 


decompose 1j as 
in 
E 11.1 
j t3 (11.1) 


where dim ğı = sı =: pio . Then, eliminating v in the last rows, write 
a = [uo (11.2) 
n f(v, w, 1) 
and set Gi(x) =: gi(a). 
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Step k+1. 
Suppose that from steps 1 through k, 


ji = fir w) + ĝi (z)v 


a z = ~ ~(k—1 ~ 2 
Uk = fk(m uw, s. wt D ji... di sois ia) 
tirs s... WO?) Tayo i a.. Ür 
^ ^ m ~ ~(k-1 p 
Uk = éx(z,w,...,w* D Gy... G8 NEEDS 
where . 
gi 
Gi = : 
Ik 
has full rank sy. Then 
x ~(k sine 
Yk = fral w, w, ja, scies di) 
Y o2 -(k—1 " 
gii (2, w, . .. ,w(* D di... gi NEST, 
Gr | 
Define Gy 41 :— $ and 8.41 :— rankGy441(x). Decompose Yy as 
k+1 


Ük- 
Îr- 


el 





+1 


) 


+1 


where dim Jk+1 = Sk+1 — Sk =! P(k+1)v- Then, eliminating v in the last rows, 








write 
Uri = fia (x, w, vues dus X E DNUS 
+Gn41(2,w,...,w&-), d... gee. es YR)U 
bicis = Pea (rot, 09 Piper tha fee) 
and set 7 
gı 
Dael 
Gk+1 


End of the algorithm. 


Algorithm 11.1 performs the inversion of X, viewed as a system depending 


on the parameter w, with respect to the input v when p, 


:— Sn equals the 


dimension of v. When w is empty, Algorithm 11.1 reduces to the usual Singh's 
inversion algorithm. The indices o;, si, and p; contain the same information, 
and each of them could be used in the following. We choose to state the next 
results in terms of pj, which have a direct interpretation as numbers of zeros 


at infinity of order i (see [119]), although 
proofs and calculations. 


the other indices are often used in 
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Lemma 11.2. Let the systems 


_ fae = f(x) + gleu 
m TE + hl(a)u a 





(RIED oma 


with outputs of the same dimension, be given, and let (GT) denote the com- 
posite system 
& = f(e) + gleu 
(GT)=4 2 = falz) + ga(z)v (11.5) 
yar = h(x) — ha(z) + h'(x)u 
Then, piv(GT) = pi(G) for all i and, in particular, p (GT) = p(G). 
Proof. Let K’ denote the field of meromorphic functions in the variables 


2,2, U,..., v -U and the parameters u,..., uU), where N = dim z + dim z. 
We denote by EC T the vector space spanned over K’ by 


{dx,dz,dyar,..., dy.) 


Note that to consider u,..., u? as parameters instead of variables means 
that the differential d(-) is given by 


d(-) = (O(-)/Ax)da + (8(-)/0z) dz + Tal )/dv dv 
1=0 


Following the proof given in ([42], Thm. 2.3) one can show that pi,(GT) = 
dimy; EST /EST. From this, since 


dyer = dyp’ — dy | 
= ój(z,u,... ,u))dz — dy? 


with $; € K’, it follows that 


Piv(GT) = dim span; (dz, dz, dya,.. dy } 
—dim spang: {dz,dz,dyq,...,dy%~} 


and hence 
Piv(GT) = dim spang: (dz, dya,... , dy) — dim spany (dz, dy, . . dy D) 
Now, let {w1,...,, Wr; } C {dz,dya,... dy) be a basis over K’ of ECT, and 


let w be an element of {w1,...,w,,}. We write 


cM B z, V,.. VND) u... uO))w; 
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with y; € K' and, computing the derivatives with respect to x, u,... uN), 
Therefore, ðyj/ðx = 0 and 0w;/Ou = ... = Oy;/du\%) = 0 for all j, or, 


equivalently, 4; = y;(z,v,-..,v'Y—)). This says that {w1,...,w,,} is a set 
of generators over the field K of meromorphic functions in the variables 
(z,v,...,v'N—)) of span, {dz, dya,... duy = EC. Moreover, since K C K', 
dime EST = dime ES for all ¿, and the result follows. E 


11.2 Model Matching Problem 


Let us now state the model matching problem (MMP). 


Problem Statement 


Given a model . f(a) (2) 
jt =jJ(x)+g(x)u 
T= s = h(a) (11.6) 


and a system G as in (11.4), find a proper compensator 


= È = fu(£z,u) 
He pete 


with state space JR? and a map ¢: IR" — IR? such that, denoting by yag 
the output of the composite system GH, yr(u, x) — yau(u, d(x), z), that is, 
the difference between the output of the model, viewed as a function of u and 
of the initial state x, and the output of the composite system, viewed as a 
function of u and of a suitably defined initial state z and € = $(x), does not 
depend on u. 

To gain a better insight into the model matching problem that we are 
considering, we now state it in a generalized form (GMMP), which includes 
in particular the left inversion problem. Specializing such a formulation by 
requiring a proper compensator, we get the most interesting case from the 
point of view of control theory. 
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Problem Statement (Generalized form) 


Given a model T as in (11.3) and a system G as in (11.4), find an integer 
v > 0, a possibly nonproper compensator 


E (11.7) 


v = hg(£,z,u,...,u(?) 


with state space JR’, and a map 9 : IR" — IR? such that, denoting by yag 
the output of the composite system GH, yr(u, x) — yau(u, d(x), z), that is, 
the difference between the output of the model, viewed as a function of u and 
of the initial state z, and the output of the composite system, viewed as a 
function of u and of the initial states z and € = $(x), does not depend on 
u), 

The MMP is the special case of the GMMP for v = 0. 


Remark 11.3. In the MMP the requirement that yr(u, x) — yau (u, (x), z) 
does not depend on u amounts, in the linear case, to the equality of the 
transfer functions of the model and of the composite systems. From this point 
of view, therefore, our formulation represents the natural extension of the one 
currently understood for the linear model matching problem (compare with 
the quoted references and with [86, 84]). 

We recall that a stronger formulation of the MMP, requiring the equality 
of yr and yag, has been considered, only for a linear model, in [39]. Note 
that the problem we stated qualifies as an exact MMP, as opposed to an 
approximate or an asymptotic MMP that could also be considered, see, e.g., 
[78]. 

Let us consider the left inversion problem in the linear framework. The 
solution provided by the Silverman algorithm [144] has the form (11.7), where 
v is the inherent integration order of the system [143, 127]. In the simple 
example given by T = {yr = y and by 





zZ=v 

ae 

we obtain 
pag tals =y 
v=y 


The difference between the outputs of the identity model T and of GH is 
YT — YGH = y — 2, the latter depends on the input y and is independent of 
the first derivative y. 


Example 11.4. Let 


and 
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Z=v 
G — 
bs =z? 
be the data of a MMP. The pair consisting of the compensator 
H = {v = u/2z 


and of the empty function is a solution in the sense of Remark 11.3. For zo Æ 0, 
t 
you (u, zo) = i u(r)dr + zà 
0 


for all input functions u(t) and for all t > 0 such that [5 u(r)dr + 22 > 0. 
Then, 
yr(u,z) — yau(u,z) = 2 — z? 
and 
d(yr(u, x) — yan (u, z)) 9 € spang (dz, dz) 


In particular, if, for example, the input is bounded by |u(t)| € M and the 
initial conditions zo, zo Æ 0, are chosen, yr — yag is independent of u over 
the time interval [0, z2/M). It may be useful to note that v = u/2z is a solution 
of the MMP in the same way, that is, with the same limitations, in which it 
is a solution, in the sense of [87], of the disturbance decoupling problem with 
disturbance measurement described by i = u, ż = v, y = x — z?, where u is 
the disturbance and v is the control. 
Note that taking, for instance, 


Mer oe 
yr = 2 


et 
UG =z 


contrarily to what happens in the linear case, the identity compensator 


and 


H={v=u 


does not give a solution of the MMP. 


yr — om = (ao — 20) exp ( i u(r)dr) 


is independent of u only if the initial states of the model and of the system 
coincide. In this case, a solution is given by the compensator 


He etn 


where £(t) € IR”, and ¢ = id. 
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A structural condition under which a compensator exists and a procedure 
to compute it are given in the following theorem. 


Theorem 11.5. The generalized model matching problem is solvable if 
&(GT) = p(G) (11.8) 

where (GT) is the composite system (11.5). 

Proof. Applying Algorithm 11.1 to (GT), we obtain 


Ey z, u, ù) 


n Fx, z, u,à,ü, Ñ, Y) 
Y; l 
Ys Fw (x, z, u, £s u), Y, "s aye eh ies Yun Y va) 
Yn ^ a ^ e E 3 
Fy(z,z,u, db uN) Ýi, ee GC Ae »Yn-1,Y n-1, YN) 
Gy 
G»(x, z,u, Y1) 
E v 
Gy(z,z,u,...,u 3, Y,,.. S YU yu) 
0 


(2G 
(11.9) 


with rank G = # rows G = p,(GT) and where Y; represents a suitable subset 


of rows of v. which will be useful to denote also as y ©) We can 


T4 Yau 
choose constant values 


Yi vee 
Y= for Y = a 
Yn-1 Yn-1 
0 Yn 


such that the generic rank of G evaluated at Y is equal to the number of rows 
of G. Then, solving for v the system 
Y, 
: | =Fy+Gyv 
Yn 
obtained by replacing Y with Y in (11.9), we get 


= O(a, zZ, U, Heo Lu Ys, dy En state ,Yn—2, YN 2, YN—1) 
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Now, denoting by wo a vector of the same dimension as x and by w; a vector 
of dimension (N — i): dim Y;, we set v = N, and we construct the compensator 


two = f(wo) + g(wo)u 


(ie 0 
H=4 ii| ipw: forl<i<N-2 (11.10) 
AE A 
( ce Y, 
v = $(wo, z, u,...,uUD w,...,wn—2, Yw-1) 


Letting (x) = (#,0,...,0), we claim that (H,@) is a solution of the 
GMMP. To show this, let us first note that, in (11.9), Yy is indepen- 
dent of u) for all k. By Lemma 11.2 and the rank equality (11.8), it 
follows that p(GT) = p,(GT) and we know, from ([42], Theorem 2.3), 
that the dz,dz,dY1,..., dY( U,...,dYw are independent over the field 
K. So, if OFy/Ou(? 4 0, for some k > 0, dY¥y does not belong to 
spany {dz, dz, dY;,..., dY( P, ... , dYw] and then p(GT) > p,(GT), con- 
tradicting the assumption. 
Now let us consider the composite system (GH): 


w = F(w) + G(w)u 
(GH) = 4 ż = fa(z) + ga(z)o(w, z, u,... uU) 
yan = he(z) 


initialized at (zo) = (ao,0,...,0) and the difference yr — you between the 
output of the model and that of (GH). Recalling the notation Y; = y — D 
by substituting the output of H to v in (11.9) and taking derivatives, 


Ve. Vena —cYfolsisN-1 
(N) (N) 


YT.N — You.w — 0 
Therefore d(yr — you) € spany (dz, dz, dw, du,...,du(V- D for all k. Em 


It is worthwhile to note that, although in (11.7) the compensator H is de- 
scribed in a very general form, the construction illustrated in the proof of 
Theorem 11.5 always produces a system whose state equations have the same 
form as those of the model. In particular, the derivatives of the input appear 
only in the output function Ahg(£, z,u,...,u?). A structural condition un- 
der which there exists a proper compensator H, that is, one which does not 
depend on the derivatives of the input u, is given in the next theorem. 


Theorem 11.6. The MMP is solvable with a proper compensator H of the 
form ! 
y [E= fut zu) 
v = hg(&, z,u) 
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if 
pi(GT) = pi(G) (11.11) 
for all à > 1. 


Proof. Assume that (11.11) holds, then, for all i, by Lemma 11.2, pj,(GT) = 
pi(GT). In particular, this implies that at Step 1 of Algorithm 11.1 applied 


to (GT), ] N 

Xi Fila, z,u) i Gi(z) v 

Y, A (x, Z, U, Yı) 0 i 
where OF, /ðu = 0; otherwise pı(GT) would be strictly greater than o1, (GT). 
Repeatedly applying the same argument, we get at the last step N, 


( Y ) b (eu Fm A (eaten) f 


Yn Fy(z,z,u, Y,..., YO?) 0 
and, hence, v = $(z, z, Y,..., Y CN-9). Therefore the compensator obtained 
following the construction described in the proof of Theorem 11.5 is proper 
in this case. [| 


Example 11.7. (i) The MMP concerning the model 


X2 00 
C= e + 1) u 
T= T4 00 
0 01 
w=(2) 
and the system 
0 z3 0 
DES ZA 01 
TN E ER ud ed: 
0 01 


142—243 


was considered in [43]. It was shown that the geometric necessary condition 
given in the same paper is not verified, although the compensator 


C= O/C e +1/(¢ +28)(-¢ Du, 
00 
7 (cone cy) eem T) 


provides a solution of the problem (see [43], Example 5.4). It can be easily 
checked that (11.11) is verified, that is, p;(GT) = p;(G). Then, applying 


H= 
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the procedure illustrated in the proof of Theorem 11.5, we get the proper 
compensator 


£5 00 

0 10 
H' g= £4 F 00 u, 

0 01 


"m ( Z4 — £2 ) 
~ \ (24 — £2 — u123 — uz)/(Éa — za — 24) 


Clearly, by removing the unnecessary equations £4 = £2, €3 = £4, and £4 = ua, 
we obtain another compensator, say H”, that solves the problem. Now, the 
change of variables G = z4 — 2 transforms H” into H. 

(ii) Consider the model 


eG): 0: 
(i) 


and the system 


for which p(GT) = p(G). Note that, since 


fo vr(r)dr + 21(0) 
jee IM və(T)dTr — exp (Ch vi(r)dr) n exp (f vi(o)do) v2(T)dr 


+2(0) + 23(0) exp (I Ui (r)dr) 


and yr. = 0, contrary to what happens in the linear case, it is not possible 
to find a compensator H such that yr — yag = 0 for u # 0, also when we 
are allowed to choose the initial condition z(0). Applying Algorithm 11.1 to 


(GT), 
" Yi 0 1 0 TET 
Y = E = m — . . v= F + Gv 
(2) ae) ie i) 
and then, in fixing constant values Y for Y, we are obliged to choose Yi #0. 
—1 


1 
0 u + za 
itself a compensator H that solves the problem. 


Taking, for instance, Y = , we get v = , which represents by 
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Remark 11.8. The conditions of Theorems 11.5 and 11.6 are not necessary for 
the existence of solutions of the GMMP and the MMP, as pointed out by the 
following example, taken from [77]. Let 


X2 00 
: T3 10 u1 
vor ge o6 dd a 
T= T4 00 
T2 
yr = | V4 
Tı 


and 


zl 


By applying Singh's Algorithm to G, we get o1(G) = p2(G) = p3(G) = 2. The 
same procedure applied to (GT) gives 








YGT1 = T3 T U1 — U1, 
YGT2 = {4 — V2, 
YGT3 = T2 + 22(Yer2 — t4 — 1) 





and then, 





ÜcTa = Yarı + 22(Yer2 — 24) — (ari — 2a — U1) (Yor2 — v4) 


So pi(GT) = 2, p2(GT) = 3 and the sufficient conditions of Theorems 11.5 
and 11.6 are not satisfied. However, the compensator 


£5 00 

é£-[& | [10 (3) 

H= 0 Y x 
v= fatui 


v2 = 0 
and ¢ = id give a solution of the MMP. 


From (11.9), we get the equality 


Y ERG seul d. s y a ie ÝN) 


= (N—2) 


: ; (11.12) 
TGy(z,2,u,...,u-2,Y1,..., Y yos YN-1)U 


and, by differentiation of Yn; the equalities 
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Yu = Êy (z, 2,U,... uN), Yi, rene TOS, nn Yn-1, Yvi, Ýn), 
yore) E Fusq(a, 2; u, ccc yum Yi... POTD, Ýn, (11.13) 
rig c vc-(n4-q— AN 
y (*- ND, Yn)... Verte) 
from which it can be understood that a weaker condition for the existence of 
solutions of the MMP is, in particular, that there exists a vector of functions 
Y; (x, z) 
Y(z,z)— : 
Yn (a, 2) 
such that 
i) OY“) /Ou = 0 for all k; 
ii) substituting Y (z, z) and its derivatives for 
Y 
Ye : 
Yn 
and its derivatives in G, the generic rank is equal to the number of rows; 


iii) substituting Y (x, z) and its derivatives for 


wa 


Y 

e 
Yn 

and its derivatives in F Nin [S F , all the coefficients of the monomials 

in u,...,u"+9, and, respectively, all the coefficients of the monomials in 

à, ... u+), are zero. Such a condition is verified in the above example 


for Y(z,z) = ( i 


24]. 


11.3 Left Factorization 


It is well known [25, 70] that in the linear case (11.8) and (11.11) are necessary 
and sufficient conditions for solving the GMMP or the MMP, also when no 
feedback connection between the state of the system G and the precompen- 
sator H is allowed. In such a formulation, the linear GMMP amounts to the 
problem of factoring the transfer function of the model T through a possible 
left factor, represented by the transfer function of G. It is natural, then, from 
an abstract point of view, to consider also the dual problem, which consists of 
factoring the transfer function of T' through a possible given right factor (see 
24, 25, 70, 107]). In the more general context we are considering, this leads 
to the following formulation for what we call the left factorization problem. 
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11.3.1 Left Factorization Problem (LFP) 
Problem Statement 


Given a model T' as in (11.6) and a system 


Hs luu A (11.14) 


find a proper compensator 


= & — falé, v) 
oS bs E ha(&,v) 


with state space JR? and a map ¢ : JR” — IR? such that, denoting by Yay the 
output of the cascade GH, yr(u, xo) — yau(u, $(xo), zo) = 0 for any initial 
states Xo, Zo. 


Problem Statement(Generalized version): GLFP 


Given a model T as in (11.3) and a system H as in (11.14), find an integer 
v > 0 and a possibly nonproper compensator 


= c=] (£, v, ... , v?) 
P pe cq M (11.15) 


with state space JR’, a map 9 : IR" — IR? such that, denoting by Yex the 
output of the cascade GH, 


yr — (u, zo) — yan — (u, ó(xo), zo) = 0 (11.16) 
for any initial states zo, zo. 


Remark 11.9. The same considerations as in Remark 11.3 apply to the present 
situation. Therefore a solution (G, $) will be one that achieves (11.16) for all 
initial states xo, zo in an open and dense subset of the state spaces. 


The first result we have in this framework is the following theorem. 


Theorem 11.10. The GLFP is solvable only if 


o(a) = «an (11.17) 


TY. E . 
where (z) is the system consisting of the state and output equations of T 
and H. 
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Proof. We start by proving the theorem under an additional technical as- 
sumption on the system H. Assume that the maximal regular controllability 
distribution R*y of H contained in ker dg is locally well defined, i.e., that 
the regularity conditions of ([86], 86.4) are satisfied. Denoting by G the distri- 
bution spanned by g#(z), we assume that the following holds: 


dim(G U R4) =m — p(H), (11.18) 


Now, let the regular feedback u = o(z) *- B(z)w be a “friend” of Rj, and let us 
denote by (z) the system obtained by compensating the system bi with 
u = a(z) + 8(z)w. By (11.18), the action of the feedback u = a(z) + B(z)w 


transforms H into the system H which, up to a change in coordinates, is of the 
form [86] 41 = fi(z1) + gi(ai)wi, 22 = fo(z1, 22) + 9203, 22)w, v = hg(21), 
where w = (w1, w2), Wi = (wi,...,Wp), and p = p(H). Hence, 


dv) (w, zo) 
Ow; 


for alli > p+ 1 and for all k. Moreover, if (G,@) is a solution of the GLFP, 
the output trajectory Y (w, xo, (20), zo) of the cascade composition between 


(z) and the system 


=0 (11.19) 


e a qs 
y = yp — he(é,v,...,u™) 


initialized at (xo, $(xo), zo), is identically zero. This, together with (11.18), 
implies 


dy) (w, xo, (z0), 20) _ Ou (w, mos zo) yE} (w, xo, (#0), zo) 


Ow; B Ow; Ow; 
_ dy (w, 20,20) — dy (yg (w, zo), (vo) 
Ow; Ow; 
ay” (w, £o, Zo) 
_ Oy? (ug Co 20), (a0) | Ou (ws zo) 
Oyg Ow; 


ay) (w, To, zo) 


Ow; 
=0, for alli >p+1 and all k 


Therefore, p (a) is not greater than p(H) and, as a consequence, 
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(E) =G) m 


The general case can always be reduced to the previous one. If (11.18) 
does not hold, one can pick p(H) independent output components of H that 
can be decoupled with a regular dynamic state feedback [49, 38, 125]. Then, 
the extended system Hp verifies dim(Gz U Ryp) = m — p(Hg). Since any 
solution of the GLFP concerning T and H also solves that concerning Tg and 
Hg and since the regular dynamic state feedback does not affect the system's 
rank, the conclusion follows from the first part. [| 


In general (11.17) is not sufficient for the solvability of the GLFP. However, 
under (11.18) and an additional technical condition, which assures the possi- 
bility of expressing z locally as a function of the output and its derivatives, 
it is possible to get a local result. More precisely, it is possible, for any zo in 
an open and dense subset of the state space, to find a neighborhood Dp and 
to show the existence of a compensator G and a map $ which achieve (11.16) 
for z € Do. We will say, in this case, that the LFP is locally solvable. 


Theorem 11.11. The GLFP is locally solvable if the following conditions 
hold: 


: T 

i) p P = p(H); 

ü) dim(Gz U Rgp) =m — p(H); 

iii) X` ;>o(p(H) — si) = n, where n = dim z, so = 0, and the s; are obtained 
by applying Singh’s inversion algorithm to H. 


Proof. We consider a friend of Ry, u = a(z) + B(z)w, as in the proof of The- 
orem 11.10, and we use the notations introduced there. By the rank equality 


p be) —p (2) = p(H), since (11.19) holds, the input components wi, 


with i > p+ 1, do not affect the output of (a) By applying Singh’s inver- 


sion algorithm to H, 
T = V(z, v, ù, , v?) (11.20) 
where w is a meromorphic function of its arguments and, in particular, it is 


defined for all z in an open dense subset of the state space. Moreover, using 
arguments as in ([87], $4), one can show that, by (iii), the Jacobian matrix 


u—hg(a) 
ð $4 — 01(z, 91) 


Oz 


in — Oy (2,01, .., ETP... iy) 
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whose elements are obtained by applying Singh’s algorithm to H, has rank 
n. Then, for any z in an open and dense subset of the state space, there 


exists a neighborhood Do of zo such that z = x(v,0,... v?) for z € Do. By 
substituting in (11.20), à4 = (v, ù, ... , v). Now, writing the state equation 
$ = fi(x,z) + (x, z)w + ga(v, z)we 


of (2) as 
= fo(z) + gs(z)w 


we can consider the system 


G= r = filé, xlv, 0,...,0%)) + gi(v,d,...,0))d(v, 0,...,0)) 


ya = h(£) 
E n = fa(£,v, 0, ... ,v()) 
ya = h(&) 


and we claim that (G,q), where ọ is the identity map, is a solution of the 
GLFP relative to Do. By inspection, one sees that the output trajectory 
Y (w, xo, e(xo), zo) of the system 


t= filz, z) T gi(z, z)u1 + ga (x, z) Wo 
Lee 
E - filé, z) + gı (£, z)Ū1 


y = h(x) — h(£) 
is identically zero for all w. Inverting the feedback u = a(z) + 8(z), we obtain 
yr(u, xo) = ya(u, (xo), zo). E 


Example 11.12. Let the systems 


iu 
T= 
YT — «X 
and 
Z1 22 
H= zg =u 
ig 


be given. The conditions (i), (ii) of Theorem 11.10 are clearly verified as well 
as (iii) because p(H) = 1, dim z = 2, sı = 0, s2 = 1. In this case, there is no 
need to apply any feedback. By Singh’s inversion algorithm, u = w(z, v, 0, 0) = 
(9 — 222)/2z1 and v — z? = 0, ù — 22123 = 0. Since 


o v—22 | [-22 0 
Oz \0-Qaz) \ 22 2 


has rank 2 for z1 Æ 0, we can express z as a function of v, ù in the neighborhood 
of any point for which zı 4 0. In particular, here, 
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(2) x00) = (Yq) tora >o 


Then, the compensators 


| 0$ —i?/2v 
geom 
Joe 
and 
. 8 — d? /2v 
G3 = LER 2/v 
ya =€ 


together with the identity map, are local solutions of the GLFP, respectively, 
for zı > 0 and for zı < 0. 


When a proper compensator is sought, the necessary condition (11.17) has 
to be strengthened into the equality of structures at infinity, and one obtains 
the following result. 


Theorem 11.13. The LFP is solvable with a proper compensator 


gap falé, v) 
ya = halé, v) 
only if 
i (5. = aH) (11.21) 
for all i» 1. 


Proof. Let K denote the field of meromorphic functions in the variables 
(z, z,u,... u9) where N = dim x + dim z. By definition, 
T : ; ; O 4, (4) 
Pil op) = dim span, (dz, dz, dyr, do, ..., dyp , dv") 
—dim span, (dz, dz, dýr, do, . . dy 1) ,dv6- D) 
Denoting by K^ the field of meromorphic functions in the variables 
(a, Z, £, u, TON uc 71), 


since neither T nor H depend on £, 


pi o = dim spang (dz, dz, d£, dýr, dù, . .., dyj), dv?) 


-dim spang (dz, dz, d£, dýr, dù, . .. , dy P , qv 6-9) 


(k) 


Since yag = yr, one can substitute dy&p in dy? for all k in the equation 


above, thus 
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T à l 
pi (a) = dim spang, {dx,dz,d€,dycu,dt,... dy, dv} 
-dim spang, {da,dz,dé,dyan, dù, . .., dy” dv} 


Moreover, by the properness of (GH), we have also that 
dy e dz, dz, d£, dù, . . ., du? 
Yor €spanc (dz, dz, d£, do, ..., dv) 


thus 
Pi E = dim spany, (dz, dz, d£, do, ... do?) 
—dim spany, (dz, dz, d£, dà, . .., dui-?)) 


Let K” denote the field of meromorphic functions in the variables 
(z,u,...,u("-)) where n = dim z. Since 


dv(9 € spany» (dz,du, dà, ... ,du*- D 
for all k € n, we get finally 
T ] ; 
pi (5 = dim span, (dz, d, ..., dv?) 


—dim spany» (dz, dù, ... , dvC- 7) 
= pi(H) 


12 


Measured Output Feedback Control Problems 


For all control laws designed in the previous chapters, it was assumed that all 
state variables were available for measurement. This is seldom the case and 
two issues then exist: 


e either the state variables are estimated by a (nonlinear) observer; 
e astatic or dynamic output feedback is sought directly to solve the control 
problem considered. 


In this chapter, we will investigate the second option and solve some control 
problems either by output feedback or by measurement feedback. 


12.1 Input-output Linearization 


The second option was considered in [113, 114, 162]to solve the input-output 
linearization problem via static or dynamic measured output feedback. 


12.1.1 Input-output Linearization via Static Output Feedback: the 
SISO Case 


It is shown that linearization by input-output injection plays a crucial role in 
the solution of the feedback linearization problem by static output feedback. 
Consider the nonlinear control system 


t= f(2,u) 
. 12.1 
y = h(a) PAN 
where x € IR", u € IR, y € IR, and f, h are meromorphic functions of their 


arguments. 

Find, if possible, a static output feedback u = a(y,v) such that the closed- 
loop has a linear input-output relation. Let n = dimO.. The solution of the 
problem is provided by 
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Theorem 12.1. Assume that the relative degree of y is finite. The input- 
output linearization problem is solvable for (12.1) by static output feedback if 
and only if 


(i) dy is linearizable by ñ output injections $1(y,u), ..., dn(y,u); 
(it) dim m (span (dy. dói,..., dó;)) = dimy (spany (dy, d$1, ..., dda ]). 


Proof. Necessity: Let u = a(y,v) be the linearizing output feedback and 
y(y,u) its inverse, i.e., v = y(y,u). Denote by r the relative degree of the 
output y. The linearized closed-loop system is described by the following equa- 
tion: 

dy (9 = A4dy (^79 +... E Andy + B, dv ^77 E... + Badu 


where the A;'s and 8;'s are in JR. Substitute v = y(y, u) and get 
dy) = Ady) +--+ + Andy + Bd [y(y, u) 7? +--+ + Badly(y, u)]. 


Let d¢@i(y, u) = A;dy for i = 1,---,r—1 and d¢@i(y, u) = A;dy + Bidy(y, u) for 
i=r,---,n. Thus, the conditions (i) and (ii) in Theorem 12.1 are necessarily 
fulfilled. 

Sufficiency: Conditions (i) and (ii) in Theorem 12.1 yield 


bly, u) = àiy + bily, u) 
for i =1,...,m, and 
dy™ = Aidy79 +--+ Andy + Bidly(y, u)] 97D +--+ Bad[y(y, u)] 


Since the relative degree is finite, the equation y(y, u) = v can be solved in u 
which yields the required output feedback. E 


Example 12.2. Consider a simple inverted pendulum of length l as in Figure 
12.1. Its model is standard and is given by 


Fig. 12.1. Inverted pendulum 
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tı = T2 
tə = kız2 + k» (sin 21) + k3u (12.2) 
y= Tı 


The angular position of the pendulum with respect to the vertical is denoted 
by zı. The input torque is u, kı = —f-/ml?, ko = g/l, ka = 1/ml?S, m is the 
point mass at the end of the pendulum, fe is a viscous friction coefficient, and 
g denotes the gravitational constant. The system fulfils 


ğ = kız2 + ko (sina) + k3u 


and thus 
ü = ky + daly, u) 


Obviously, the input-output relation is linearized by the following output feed- 


back: 
1 


os 


and the closed-loop system input-output relation is gj = kiy + v. 


u (v — ka sin y) 


12.1.2 Input-output Linearization by Dynamic Output Feedback 


In practice, the conditions of Theorem 12.1 are strong; it is seldom that there 

exists a static output feedback solution of the problem considered. Thus, it is 

interesting to search for a solution in a much wider class of compensators that 

still can be implemented that easily: the class of dynamic output feedbacks. 
Consider first the following introductory example: 


1 
tı = T2 — 5 In(zi + 2u) 





zxı+u 1 29 — 4 ln(zı + 2u) 
= ean (pete ara 2e eee 12.3 
i3 atti xı + 2u ( ) 
y =īi 
whose input-output differential equation is 
F d 
y= $2 dt [1 (y, u)] pu (12.4) 
where ¢1(y,u) = u, ó»(w, y, u) = E ec Although this structure is different 


from the one that characterizes linearity up to output injections, it allows the 
design of a dynamic compensator that solves the input-output linearization: 
set 


y= U 
Us bud (12.5) 
yt2u 


Then, the dynamic output feedback is deduced 


152 12 Measured Output Feedback Control Problems 


n=ytn—(yt2n)v (12.6) 
u= 


and the closed-loop system is linear since its input-output equation is y = v. 
What was operated on this example can be done on general nonlinear 
systems. Let us first state the problem before giving a sufficient condition 
under which a solution exists and can be constructed. 
Problem statement : Given system (12.1), find if possible, a dynamic 
output feedback 
u= Aly, n, v) 
i= Flymo) ree 


such that the closed-loop system 


t = f(x, H(h(x),n,v)) 


ù = F(h(z),u,v) (12.8) 
y = h(a) 
is diffeomorphic to 
Q = AC + bu 
Q = f?(¢,n,v) (12.9) 
y = cc! 


where, n € IR*, C! € R”, € R°”, and (c, A) is an observable pair. 
Two sufficient conditions are given successively below. Both generalize the 
structure (12.4) in the introductory example. 


Theorem 12.3. The system (12.1) can be linearized by dynamic output feed- 
back if i : g 
dy™ = Ady(97D 4... + Ardy" +D + db (12.10) 


where 
d d d 
P= pal, y, u) o gériow u) O... O qe Prtie ye) 9 girov) 
and A; € IR. (i=1,...,r— 1). 


Proof. Consider the system (12.1). 
Let 


m := br(y, u) 
72 := r41 (01, y, U) 
T]3 :— $r42 (Tio, y, u) 





(12.11) 





Naar := Ón 1 T 1,9, u) 
U:-— Ón(f)jn—r, y, u) 
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From the definition of the relative degree r, 2d Æ 0 and x Æ 0 for 
u i—1 
i=r+l,...,n. Thus, the following dynamic compensator is well defined: 
u=; (ym) (12.12) 


hi = pilm Yy do (ym) i-1L1...n-r-1 
tar = n (vy, r (y, m)) 
Substitute (12.12) in (12.10) and get the closed-loop system behavior: 
dy™ = Ady(97D +... 4+ A, ídy77*D + dv (12.13) 
System (12.1) has been linearized by dynamic output feedback. E 


A way to check condition (12.10) is provided by the following algorithm. It 
allows us to compute the required functions ¢; (i = 1,..., 5) whenever they 
exist. Denote £^ = £(dy, ..., dy(*- 9, du, ..., du^. 


Algorithm 12.4 Assume that, 
dim F” = 2n. (12.14) 


Initial check: dy™ € E”. If false, stop! If true, denote w, = dy. 
Step i (i=1,...,r-1). 
Pick functions & such that wi — £jdy-? € E?—/. Let oj = ĉidy. Check: 
©; € spange(dy]. If false, stop! If true, define wii = wi — Ùi. 
Step r. 
Pick functions £,,0, € K such that wr — €.dy®-") — 9,du(^-"? € E°". Let 
@, = €,dy + 6,du. Check: dio, ^ io, = 0. If false, stop! If true, define ¢,(y,u) 
such that 

D, = Andy (12.15) 


" Ody 
where A, € K. Denote zr41 = or(y,u). If = #0, rewrite wy so that wr € 
E y 
spang{dz 0T”, ...,dz2, du"), ... du, dy}. 


y% -o ot S 





#0, rewrite w, so that 


Wr € span, (dz 1" D, ics dzr41, dygUt 779 ... dy, du} 


Step 0 ((—r-4-1, ..., n-1). 
Pick £e, 0e, we € K such that 


wr — pedz\"—9 _ £dy (7-9 — (,du(^-9 € pn-* 
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Set we = edze + Eedy + bedu. Check: dwe ^ We ^ doe—ı = 0. If false, stop! If 
true, define de(ze,y, u) such that 


we = Acdde + yede- (12.16) 
where ye, A; € K. Denote zg41 = dbelze,y, u). Rewrite w, so that 


wy € span (dz(71* D... , dz; 4, dy", ... dy, du49... du) 


Step n. 
By definition, wy € span (dzz, dy, du}, and 


dw, = 0 


End of the Algorithm. 


Theorem 12.5. Under assumption (12.14), dy? € E can be rewritten in 
the form (12.10) if and only if dy? € E” and 


da, ^U, = 0 (12.17) 
day ^Gg^d$; 120, L=r+1,...,n— 1 (12.18) 


e there exist 6£1,..., 6, 1 € IR, such that 


r—1 
dy™ — V ^ Edy) e pn^ (12.19) 
i=1 
Proof. Necessity: Thanks to Theorem 12.3, the necessity of (12.19) is obvious. 
Assume that there exist ñ — r + 1 functions ¢; (i = r,...,ñ) so that dy? 
reads as in condition (i) of Theorem 12.3. Then, from (12.15) and (12.16), the 
differential 1-forms ©; can be rewritten as follows: 


Abn Oóna ðr 


Op = — : 
Obn—-1 Obn-2 Or 
: Oón Oón-i . Oórj2 











dor (y, u) 

















r = — - mms de, A anti 
Gl wm cp Oe Qa (Qv, y, u) + ^41dó 
2 i | 
Ogn-1i = Ip dén_1(da—2, y, u) c ya-1dóg-2 
Oón-1 


This proves the necessity of (12.17) and of (12.18). 
Sufficiency: The sufficiency of Theorem 12.5 follows from Algorithm 12.4. NM 
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A weaker, but more complex, sufficient condition is given now. 


Theorem 12.6. System (12.1) can be linearized by dynamic output feedback if 





Jñ, qEN dy™ = dyd +--+ Andy (12.20) 
+d [e«t i $472, 01, y, U) 


d s i 
eat g »Pq—31 ++ +391, Y, U) © 
d d 
oF pal i y, u) 9 aci Gr u) 


where 22 4 Q, and A; € IR. (i — 1,..., fi). 


Remark 12.7. Since the observability index cannot decrease, n > n, and since 
the relative degree cannot decrease either, rn — q +1 >r. 


Proof (Proof of Theorem 12.6.). Consider system (12.1). Let 
m := or1(y, u) 


n := (mm, y, u) 
n3 := $3 (12,15 Ys u) 


(12.21) 
Nq—1 :— Gq—1(Nq—25 ++ +s Ms Y, U) 
U:— Ga (T)g—1; ee mn. y, u) 
06i 
From the definition of the relative dignes Oh I 0 and —— ry Æ 0 for i = 
i-1 


1,...,q. Define the following dynamic me. feedback: 


TH = d; (41.9; soe 5435.9. 01 (y,m)) i= 1, ee3Q0— 2 
Tlg—1 = z (v, py- Jove mon s), 1 (y,m)) 
u= $7" (y,m) (12.22) 


Substitute (12.22) into (12.20) and get the input-output relation for the closed- 
loop system: g i 
dy(9 = \ydy-) +--+ Aady + dv (12.23) 


Thus, system (12.1) has been linearized. E 
If q € n, an algorithmic necessary and sufficient condition is given by Algo- 
rithm 12.9. 


The following lemma is required to introduce Algorithm 12.9 ([81], Lemma 
2.6). 
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Lemma 12.8. Consider a cospace N C 2 and a1-formw € and w € f. 
Then, there exists x € Q such that d(w + T) ^ (w + T) — 0 if and only if 


dim(span{w} + 2)* > dim(2)* +1 (12.24) 


where (2* denotes the largest integrable subspace contained in a given space 
Q. 


Algorithm 12.9 Assume that q <^. p 

Initial check: 3o,..., 05-4 € IR such that dy? — Y^? o;dy(^-? € EY. If 
false, stop! . 

If true, denote w = dy — 35-1 ajdyC—?. 


Step 1. 

Check 1.1: w € E^. If false, stop! 

If true, pick functions &,04 € K such that w — £y dy(*-? — badu) € Et, 
Define a differential 1-form œ such that 4 = £1dy + 01du. 

Check 1.2: dw, ^ à — 0. If false, stop! . 

If true, let di(y,u) such that à1 = A1d$q where Ay € K. Let zı = ġı (y, u). 


Step 2. 
Check 8.1: w € E! + span{dz ?. If false, stop! 
If true, pick functions &, 62, u21 € K such that 





w= pdz!” = £5dy 07? cg 4-9 e ge? 


Define a differential 1-form © such that wz = u21dzı + £2dy + 03du. 

Define 22 = span{dd¢}}. 

Check 2.2: dis ^ w2 ^ d$, = 0. If false, stop! 

If true, then there exist m2 € 21, A2 € K, and $2(z1, y, u) such that w2 + 19 = 
A2d$». Let 22 = o2(21, y,u). 


Step £ £< q-1). 
Check l.1: w € E9! + span(dz(4 5, Rea" dz1?). If false, stop! 
If true, pick functions £101, uii... pui € K such that 


w — m 1dz —...— pi 1d? — £y? =f De pet 
Define a differential 1-form such that 


Gy = pt—1d 1-1 +++ + pi dz1 + Edy + Ordu 


Define the cospace 


k-1 öğ 
NQ = span{ > 3; Vik =1,...,min(l — 1,q — l); dd} 
i=1 ^ 
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Check 1.2: dim(span{a@} + 21)* > dim + 1. If false, stop! 

If true, then there exist y; € 21, M € K and di(z1,..., 21-1, y,u) such that 
a+ Tp = Ardoi. 

Denote zj = di(z1-1,---,21Y,U)- 

Step q. 

Check q.1: w € E! + span{dz1,...,dzq-1}. If false, stop! 

If true, pick functions £q, Oq, q.i, +++ Mqq-1 € K such that 


W = Hg,q-1dZq-1 d +++ + Hq, 1dz1 + Egdy + 04du 


Check q.2: dw Aw = 0. If false, stop! 
End of the Algorithm. 


One defines a triangular endogenous dynamic output feedback as follows 


u= Fi(y,m) 
ù = Fo(y,m, 2) (12.25) 
72 = F3(y,m,- ee 13) 


"q—2 = Foaly,m,; e -> Nq—1) 
"q—1 D Eo Ni- -s Ng—1,0) 


Endogenous feedbacks have first been considered in [115]. Note that (12.12), 
(12.22) are triangular endogenous dynamic output feedbacks. This class of 
feedbacks, (12.20), is necessary for the dynamic output feedback linearization 
problem. 


Theorem 12.10. There exists a triangular endogenous dynamic output feed- 
back that linearizes the input-output relation of system (12.1) if and only if 
condition (12.20) is fulfilled. 


Proof. Sufficiency: The sufficiency follows from the proof of Theorem 12.6 
since the compensator described in (12.22) is a triangular endogenous dynamic 
output feedback. 

Necessity: There exist (12.25) such that the linear closed-loop system reads 


dy™ = dydy-) +--+ Agdy + iude) +... + psgide (12.26) 


for some integer s. Define the following triangular endogenous dynamic output 
feedback: 


v= & 

& = & (12.27) 
: 1 

Es = — [w — pa€s-1 — ... — Ms 411] 


Hı 
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The composition of (12.25) with (12.27) maintains the structure of the trian- 
gular endogenous dynamic output feedback and yields 


dy™ = A dy 79 4... 4 Andy + dw (12.28) 
Thus, without loss of generality, assume that the triangular endogenous dy- 
namic output feedback (12.25) yields (12.28). From (12.25), 
m = FQ yu) 
n2 = Fy" (in, y, u) (12.29) 
n = Ri (72,71, y, U) 


w= F; ' (Tig 1... y, U) 


Thus, one obtains the following expression for w : 
; . d : : 
w = Pal A 097255 9n 9, u) o zaal i 10323515 OI M) O... 
Taal diyu) o Egilu u) (12.30) 
g= t o — u . 
dt 2 91; U dt 14; 


where ¢; = F; ! for i = 1,...,q. Combining (12.26) and (12.30), the result 
follows. E 


Theorem 12.11. Assume that dim E” = 2n andq < n. Fori > n, dy™® can 
be written as (12.20) if and only if all checks in Algorithm 12.9 are fulfilled. 


Proof. The sufficiency obviously follows from the construction of Algorithm 
12.9, since dw ^ w = 0 at the end of Step q. 

The necessity is proven by induction. The necessity of the initial check as 
well as the necessity of the two checks in Step 1 are obvious. Assume that all 
checks in Steps 1,...,l, | < q — 2 are fulfilled; then, one shows that the two 
checks in Step l + 1 are fulfilled as well. 

Let 


z1 5 ài (y, u) 


z — dizi... 21,9, u) 


Then, by assumption, for some € € K, 


w = Edoq(q-1; seky bust, Zly eee 5 Z1, y,u) 
= d ————d n— eee * d 
$ s z A 2 OA Pii 





Obq 
— eS 12.31 
+ Jz dz +... + Ja da) (12.31) 
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Since d¢j41 C span{dz,...,dz1,dy, du}, 


digi C span{dy...,dz1,dy, dù, dz,...,dz1, dy, du} (12.32) 
and 
dóia C span{ddi41,...,dé1,dy, du} 
C span(———— dare ,dz...,d21, dy, du} 
mee span{dz...,d21,dy, du, dz,,...,dz1,dy,du} (12.33) 
Thus, 


dói42 C span(dy, dy, dij, du, dù, dü, dzi, d2;, dZ;, i =1,...,1} (12.34) 
In a similar vein, one proves that 
d$,.1 C span(dy, ..., dy (472, du, . .., dul“), (12.35) 
dz,...,da* —- S MEME: 
and 
dó4.1 C span(dy, ..., dy"), du, ... , du (471 7U, (12.36) 
dzi,...,dzH 9 i =1,...,0} 
Thus, from (12.31), (12.32), (12.34), and (12.36), 
w € ET! + span(dz,..., daz ^ 9) (12.37) 
It is shown by induction that 
span{dz;,...,dz\")} c gi** (12.38) 


span(dz;,... da 1729 c E™ -1 espan(dz (817, j = 1,...,i—1} (12.39) 
for i =1,...,1. 
For instance, let us prove (12.39). 
Equation (12.39) is fulfilled for i = 1 due to the definition of z1. Assume 
that it is fulfilled for i — 1. Since 
span{dz;,... da 179) C ET? 4 span(ds;,..., 
dz 97170, j 51,...,i- 1) 
ad o mes 
-*span(dz(477- D, j = 1,...,i — 1) (12.40) 





where the second inclusion yields from the induction hypothesis, (12.39) is 
also fulfilled for i. 
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Combining (12.37) and (12.40), 


w € ET! + span{dz 9j =1,...,i— 1} 


It is thus necessary to fulfill the first check of Step l + 1. 
To prove the necessity of the second check of Step l+ 1, let us develop 
(12.31) which is obtained from the definition of z;: 


| 00a. 8012 Opiti g „(1-9 
os Es adr (x5 Oz; 


LI i=1 t 


42t gy (4-1-1) 4 990 gulai- 
Oy o 


u 











€ Et! E gpan(dz],4 — 1,...,54 =0,...,¢—1—2} 
(12:38) Har + span(dz, 


i=1,...,min(l,qg—l+1);j =n—l—-i-1,...,n-—1—2} (12.41) 
One has, 
dz (77179 - iay (a=1-1) 4 Pet au (q—1—1) (mod E" t) (12.42) 
C = 862 4 dz; ee (mod E? 
Oa 
+span{dz”, j =0,...,q-—I- 3}) 


(12.38) CAT ( 
Oz 
(12.42) 0$» 914 (q—1—1) 
Oz Oy dy 


+ Braue) (mod Et '~') (12.43) 


mod Et") 


—l-2 962 | i—1 

dz ) TA PR Pus ) 

(mod Eoi span{d2”), j =0,...,q-—l- 2}) 
(12:88) Pa an (mod uci span{dz{-"-)}) 
1 
O62 , (q—1—1) O1 oi 
4 Llgqya-t-210 

3z zl x H2 Oy dy 


+ Prague) (mod E*-!-!) (12.44) 
U 


3u2€K,(12.42 


— 


and more generally, one shows by induction that there exists uj;; € K such 
that 
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CES EEN eek Od, Ll Odi E pom 
ye ae ee dy) (q—1—1) q-l-1 
Zk = kl E y + p du (mod E ) 


di uus Seas 1-1) 


f2) 
+Hk21 (Haaye + Zéi auam) (mod E¢'1) 





"T D FE haa, peus es PPh AID use 
imd. oe? i=1 
tuan gerd” + Hk21 (Saco + due) 
(mod E*7'71) (12.45) 
Define the space 
No Pór ES 
M1 = peu. Dy, ——dz;,k -—2,...,min(l,q — l — 1); Dy Y yt pu 9" } 


from the definition of the differential one-form @)4, in Step L+ 1 of Algorithm 
12.9, and using (12.41) to (12.45), one concludes that the differential one-form 
T1431 € Qua such that 





Oki — M41 = 6: ———c 


O¢on-1 ðh 


IPn 3pi+2 GESI 
a Oz; Oy Ou 


ODE a. OPE 4 96014 au) 


Then, from Lemma 12.8, the second check of Step l+ 1 is necessarily 
fulfilled. 
The rest of the necessity can be proved in a similar vein. [| 


12.1.3 Example 


Consider a system described by a higher order input-output differential equa- 
tion 


y" = vy, ... NOTE uf) (12.46) 


Note that Theorems 12.1, 12.3, and 12.6 remain valid for system (12.46). How- 
ever, any input-output system (12.46) that fulfills the conditions of Theorem 
12.1 admits a state realization (12.1). An input-output system that fulfills the 
conditions of Theorem 12.3 does not necessarily admit a state realization. 
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Consider y = 7?t+utyituytyut 3yyiit jyü--y^u(9 -3gyàü--y?ü-- 
yuy. This input-output system does not admit any standard state realization. 
Note that its relative degree is 1. Let w = dy, 





w= y^ du )4 + (3yy + y?)dü + (yù + yu)dj 
(y? + 3yy + yj + y)dà + (29à + 3yü + 2yu + 2üy + 3ày + u)dg 
(3yü + yu + 2yu® + 3j + 2yü + Gut wdy + (y? + yij + y+ 1)du 











Step 1 of Algorithm 12.4 yields ©, = y?du. Then, 6 = u, A — y?, and 
= oily, u). w is rewritten so that w € spang {dż2,. .., dzo, dj, ..., dy, du}: 


w = y?dZ + (3yy + y?)da + (yza + yu)dij 


L(y? + 3yy + yj + y)dza + (2yz2 + 3ya + Qyu + 223y + 322y + u)dg 
t (3y22 + i22 + 2ya + 39za + 2y22 + ju + 22)dy + (y? + yj + ý + 1)du 








Step 2 yields à = y*dzz + yzody + yudy. The relation dia ^ à» ^ dd, = 0 is 
; d 

fulfilled. Then, 7 (2» + y?du) = dó» = d(yó1 + uy), and z3 = got + yu). w 

is rewritten so that w € span, {dZ3, dz3,dy,dy,du,du}: 





w = ydZa + ydzg + (za + u)dy + ydà + (23 + à)dy + (y + 1)du 


From Step 3, define $3 = ydz3+(z3+u)dy+ydu. The relation d&3AG3Ad¢2 = 
. dtu 
0 is fulfilled. Then, ©; = dés = d(yd2 + uy), and z4 = gee + yu). w is 


rewritten so that w € span¢{dz4, dy, du}: w = dz4+du. Thus, dds = dós - du. 
A linearizing dynamic compensator is now obtained. From $1 = u, ¢2 = 


yor +uy, $3 = yoo + uy, and $4 = $3 + u, set m = u, n2 = yh +MY, N = 
yrja + my, and v = 173 + nı. The compensator 


(n2 — my) ù =v- m 
(tla — my) u= m 


m= 
"p = 


[Re |r 


linearizes the system, and the closed-loop system admits the following stan- 
dard state realization: 


G1 =¢2 h = m- me) 
O=G fiz = zs — mG) 
C3 = 64 h3 =v- mM 
(prd qoe 


12.1.4 The Hopping Robot 


In this section, straightforward generalizations of the previous results are given 
for the multivariable case, and in the situation where the measured outputs 
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x 


Fig. 12.2. Hopping robot 


z are different from the outputs y to be controlled. Consider the kinematic 
model of a hopping robot in [61]. 

The input-output relation of this system can be linearized by dynamic 
measurement feedback. The system is not linearizable by output injections. 


paw 

L= u2 

A m(lł+1 2 

Ó = Tenet (12.47) 
y =y 
ya =0 

zl 


2muu»(£ + 1) mitt (£ + 13? 
(Ll+m(€+1)?7)? 1+m(€+1)? 
ji = $i2(6a,2,u) (i = 1,2) 


; ; 2muu»s(z + 1) móai(z + 1)? 

th = ù), = $11,031 = U1, =} 1L, 
with ġ11 = ui, $12 = $11,921 = U1, $22 (+ m(z+1)? | 14+m(z+1) 

there exists a dynamic measurement feedback which linearizes the input- 
output relation of (12.47). The compensator can be written as 


Compute 91 = t1, Y2 = . Since 


ui = 1) 
n= v 

mz 4- 1)?v 1+ + 1)?)? 
vg = hp qp PEHD ] tml +12)? 


14 m(z 41) 2gm(z + 1) 


The closed-loop relations are jj = vı and Y2 = və. 
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12.2 Input-output Decoupling 


Consider the square invertible system 


t = f(x) + g(z)u 
p= Bes (12.48) 


where zr € IR”, u € R”, and y € R”. 


12.2.1 Input-output Decoupling via Static Output Feedback 
Problem Statement 


Given system (12.48), find if possible, a static output feedback u = a(y) + 
B(y)v such that 


e dy? € span(dz, du;, o du D vk 20 
e dy? £ span(dz) 


Example 12.12. 


di = x3(sin zi + u1/ x2) 


fq = £3 + U2 


£3 = — T3 
Yı = Tı 
Y2 = T2 


This system can be decoupled without any feedback of x3. The output feed- 
back uj = —y2 sin y1, U2 = v2 decouples the system. 


To characterize fully the solvability of the problem, introduce a special sub- 
space 2; associated with the output component y;: 


Ni = (v € X | Vk € N,w) € span (dz, dy, ..., dyt} 


The subspace 2; is a controllability cospace and characterizes those state 
variables that do not have to be rendered unobservable for noninteracting 
control. The main result is now in order. 


Theorem 12.13. System (12.48) can be decoupled by a static output feedback 

u = o(y) + B(y)v if and only if 

e the relative degrees r1,...,%m are finite 

e dim(X + spany (dy), n dyg} =n+m 

e dye? € Ni ® spang (dyj, du, j Æ i) 

e dr; ^mi Ady; — 0, Vi = 1,..., m, where v; € spany(dyj, du, j Æ i} is such 
that dyf” — Tj € A. 
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12.2.2 Input-output Decoupling Via Measurement Feedback 
Problem Statement 


Consider system (12.48) and the measurement z = k(x), z € JR’. The input- 
output decoupling via static measurement feedback is solvable if there exists 
a feedback u = a(z) + 8(z)v such that 
e dy? € span(dz, du;,...,du?~) vj > 0 
° dy” £ span{dx} 

Before giving the general solution of this problem, introduce the following 
notation. Given a subspace 92 of X, the largest controlled invariant subspace 
contained in £2 is denoted N*. Denote Z = {dz}. 


Theorem 12.14. System (12.48) is decouplable by measurement feedback if 


e the relative degrees 11,...,%m are finite 

e dim(X + spany (dy), E dy }) =n+m 

e dy(ri) €Q+2+U 

e dim(spanc(mi) 6 Qj n Z)* = dim(f2; n Z)* +1 where v; € Z +U is such 
that dy? — Tj € fà, for i — 1,...,m. 

Problem 


12.1. Consider the virus dynamics model in Section 2.10.2 


T = s — ôT — Tv 
T* = Tv — uT* 


icu 
Y2 =V 


Show that this model can be fully linearized by static output feedback. 
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